-- Logs begin at Tue 2022-09-06 15:35:06 UTC, end at Tue 2022-09-06 16:41:04 UTC. -- Sep 06 16:07:27.171223 dv-cinder-852210-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 16:07:27.180021 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 16:07:27.182011 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 16:07:27 2022] *** Sep 06 16:07:27.182011 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 16:07:27.182011 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 16:07:27.182011 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: nodename: dv-cinder-852210-10-iscsi Sep 06 16:07:27.182011 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: machine: x86_64 Sep 06 16:07:27.182011 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: clock source: unix Sep 06 16:07:27.182011 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: pcre jit disabled Sep 06 16:07:27.182011 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: detected number of CPU cores: 4 Sep 06 16:07:27.182011 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: current working directory: / Sep 06 16:07:27.182011 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: detected binary path: /usr/bin/uwsgi-core Sep 06 16:07:27.182011 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: your processes number limit is 47680 Sep 06 16:07:27.182794 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: your memory page size is 4096 bytes Sep 06 16:07:27.182794 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: detected max file descriptor number: 2048 Sep 06 16:07:27.182794 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: lock engine: pthread robust mutexes Sep 06 16:07:27.182794 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: thunder lock: enabled Sep 06 16:07:27.182794 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 16:07:27.182794 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 16:07:27.220972 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: Python main interpreter initialized at 0x562a1df3c9c0 Sep 06 16:07:27.220972 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: python threads support enabled Sep 06 16:07:27.220972 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: your server socket listen backlog is limited to 100 connections Sep 06 16:07:27.220972 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: your mercy for graceful operations on workers is 90 seconds Sep 06 16:07:27.221328 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 16:07:27.221328 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: *** Operational MODE: preforking *** Sep 06 16:07:27.221618 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: *** uWSGI is running in multiple interpreter mode *** Sep 06 16:07:27.221618 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: spawned uWSGI master process (pid: 105670) Sep 06 16:07:27.221809 dv-cinder-852210-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 16:07:27.222303 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: spawned uWSGI worker 1 (pid: 105671, cores: 1) Sep 06 16:07:27.222638 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: spawned uWSGI worker 2 (pid: 105672, cores: 1) Sep 06 16:07:27.223330 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 16:07:27.879461 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 16:07:27.891775 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 16:07:28.958075 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:07:28.958075 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: from cryptography.utils import int_from_bytes Sep 06 16:07:28.958771 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:07:28.958771 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: from cryptography.utils import int_from_bytes Sep 06 16:07:28.959135 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:07:28.959135 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: from cryptography.utils import int_from_bytes Sep 06 16:07:28.959585 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:07:28.959585 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: from cryptography.utils import int_from_bytes Sep 06 16:07:31.440316 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 16:07:31.441024 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 16:07:31.441108 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 16:07:31.441439 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 16:07:31.441518 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 16:07:31.441595 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 16:07:31.441663 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 16:07:31.441727 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 16:07:31.442037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.442149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 16:07:31.442336 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 16:07:31.442446 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.442687 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.442816 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.442980 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.443092 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.443319 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.443473 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.443600 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.443693 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.443937 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.444122 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.444235 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.444332 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.444562 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.444661 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.444855 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.444965 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.445159 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.445306 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.445461 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.445551 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-10-iscsi {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.445771 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.445869 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.446069 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.446157 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-10-iscsi {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.446373 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.446461 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.446681 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.446768 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.446968 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.447051 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.447278 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.447361 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.447579 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.447668 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.447897 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.448077 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.448197 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.449695 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.449803 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.449885 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.449951 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.450021 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.450086 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.450159 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.450234 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.450305 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.450371 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.450443 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.450607 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.450805 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.450911 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.451007 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.451228 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.451316 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.451536 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.451631 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.451854 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.451996 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-10-iscsi {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.452161 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.452291 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.452557 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-10-iscsi {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.452661 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.452894 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.452996 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.453205 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.453316 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.453515 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.453620 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.453913 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.454002 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.454223 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.454317 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.454537 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.454633 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.454872 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.455001 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.455187 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.455339 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.455466 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.455566 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.455804 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.455933 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.456120 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.456310 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.456402 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.456488 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.456710 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.456869 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.457046 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.457190 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.457324 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.457424 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.457644 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.457774 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.457947 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.458092 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.458182 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.458279 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.458492 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.458645 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.458751 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.458837 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.459052 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.459183 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.459377 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.459508 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.459621 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.459704 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.459849 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.459946 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.460164 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.460271 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.460443 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.460531 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.460778 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.460868 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.461098 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.461210 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.461396 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.461482 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.461700 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.461793 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.462000 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.462095 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.462298 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.462388 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.462586 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.462706 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.462883 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.462973 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.463185 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.463273 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.463509 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.463658 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.463795 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.463926 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.464095 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.464239 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.464420 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.464547 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.464827 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.464960 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.465084 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.465217 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.465415 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.465550 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.465709 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.465799 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.466022 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.466124 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.466337 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.466436 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.466650 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.466741 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.466957 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.467045 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.467257 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.467353 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.467559 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.467647 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.467858 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.467961 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.468157 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.468252 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.468442 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.468567 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.468782 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.468871 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.469026 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.469124 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.469321 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.469409 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.469619 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.469703 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.469915 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.470009 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.470217 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.470308 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.470515 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.470599 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.470815 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.470899 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.471113 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.471196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.471414 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.471497 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.471709 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.471794 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.472006 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.472095 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.472306 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.472390 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.472606 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.472742 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.472932 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.473031 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.473231 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.473326 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.473531 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.473654 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.473830 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.473912 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.474124 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.474256 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.474422 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.474513 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.474721 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.474804 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.475029 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.475120 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.475326 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.475410 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.475625 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.475718 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.475924 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.476020 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.476226 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.476310 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.476523 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.476612 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.476846 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.476951 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.477153 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.477236 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.477450 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.477539 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.477746 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.477843 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.478053 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.478135 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.478351 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.478434 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.478649 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.478740 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.478950 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.479032 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.479246 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.479384 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.479548 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.479641 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.479845 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.479928 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.480144 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.480322 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.480506 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.480591 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.480823 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.480920 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.481125 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.481215 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.481420 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.481504 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.481717 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.481801 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.482014 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.482098 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.482311 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.482396 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.482605 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.482701 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.482904 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.483012 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.483202 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.483287 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.483507 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.483590 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.483807 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.483907 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.484105 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.484196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.484407 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.484489 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.484710 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.484864 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.485050 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:07:31.485135 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.485390 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.485565 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.485701 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.485906 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.486031 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.486251 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.486359 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.486568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.486660 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.486902 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.486996 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.487232 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.487322 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.487547 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.487638 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.487859 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.487942 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.488164 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.488254 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.488467 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.488563 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.488806 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.488893 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.489121 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.489213 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.489430 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.489527 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.489748 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.489841 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.490067 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.490151 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.490379 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.490539 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.490686 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.490771 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.490996 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.491079 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.491312 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.491404 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.491620 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.491704 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.491927 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.492009 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.492250 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.492342 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.492567 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.492652 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.492912 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.492999 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.493237 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.493323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.493557 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.493640 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.493866 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.493958 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.494174 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.494260 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.494482 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.494567 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.494789 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.494913 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.495098 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.495183 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.495406 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.495496 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.495721 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.495806 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.496065 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.496154 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.496377 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.496461 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.496688 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.496833 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.497023 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.497112 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.497330 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.497421 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.497638 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.497732 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.497944 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.498026 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.498251 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.498335 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.498560 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.498652 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.498864 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.498954 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.499178 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.499267 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.499489 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.499581 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.499802 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.499886 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.500109 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.500193 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.500419 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.500504 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.500725 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.500871 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.501054 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.501146 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.501357 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.501441 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.501658 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.501742 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.501957 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.502051 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.502256 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.502340 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.502553 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.502637 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.502859 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.502951 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.503162 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.503250 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.503479 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.503571 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.503786 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.503878 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.504093 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.504184 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.504399 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.504484 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.504704 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.504819 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.505034 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.505119 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.505343 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.505429 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.505648 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.505739 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.505951 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.506033 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.506259 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.506342 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.506562 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.506652 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.506862 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.506946 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.507178 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.507261 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.507480 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.507563 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.507780 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.507871 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.508090 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.508179 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.508391 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.508475 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.508694 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.508816 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.509028 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.509112 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.509340 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.509431 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.509648 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.509732 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.509952 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.510035 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.510257 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.510342 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.510574 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.510657 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.510882 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.510974 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.511182 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.511266 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.511561 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.511652 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.511885 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.511982 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.512194 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.512279 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.512493 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.512577 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.512818 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.512922 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.513123 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.513208 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.513420 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.513511 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.513735 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.513838 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.514019 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.514102 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.514317 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.514400 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.514615 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.514700 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.514913 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.514997 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.515209 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.515292 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.515509 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.515593 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.515809 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.515891 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.516109 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.516193 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.516407 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.516491 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.516706 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.516804 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.517028 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.517120 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.517329 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.517415 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.517630 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.517715 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.517929 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.518028 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.518269 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.518354 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.518570 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.518654 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.518891 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.519056 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.519199 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.519284 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.519508 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.519592 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.519811 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.519915 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.520116 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.520207 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.520419 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.520505 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.520722 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.520867 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.521054 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.521139 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.521358 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.521440 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.521665 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.521761 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.521966 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.522049 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.522273 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.522356 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.522578 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.522662 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.522880 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.523007 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.523182 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.523305 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.523490 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.523581 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.523805 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.523891 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.524106 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.524190 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.524416 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.524502 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.524732 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.524881 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.525059 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.525143 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.525368 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.525454 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.525672 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.525756 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.525976 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.526068 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.526279 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.526405 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.526582 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.526668 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.526887 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.526980 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.527213 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.527346 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.527518 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.527644 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.527821 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.527957 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.528127 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.528255 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.528429 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.528556 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.528733 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.528934 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.529074 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.529204 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.529334 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.529463 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.529660 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.529795 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.529960 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.530085 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.530272 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.530359 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.530576 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.530671 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.530893 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.530979 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.531201 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.531292 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.531506 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.531589 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.531811 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.531894 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.532111 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.532195 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.532410 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.532506 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.532713 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.532816 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.533039 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.533123 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.533341 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.533426 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.533642 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.533724 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.533944 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.534038 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.534251 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.534334 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.534555 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.534637 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.534853 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.534945 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.535151 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.535242 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.535454 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.535537 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.535755 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.535847 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.536057 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.536141 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.536365 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.536452 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.536680 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.536817 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.537006 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.537093 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.537311 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.537411 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.537628 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.537712 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.537928 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.538010 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.538227 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.538312 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.538523 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.538607 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.538822 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.538915 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.539129 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.539214 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.539432 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.539517 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.539733 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.539817 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.540042 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.540125 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.540359 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.540453 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.540659 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.540742 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.540991 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.541086 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.541298 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.541382 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.541602 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.541686 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.541916 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.542065 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.542222 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.542307 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.542525 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.542608 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.542887 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.542992 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.543196 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.543281 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.543496 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.543575 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.543802 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.543900 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.544109 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.544192 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.544410 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.544501 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.544716 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.544847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.545045 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.545131 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.545346 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.545430 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.545652 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.545736 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.545959 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.546051 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.546257 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.546520 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.546613 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.546849 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.546933 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.547160 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.547411 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.547499 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.547744 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.547831 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.548055 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.548157 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.548370 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.548461 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.548718 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.548840 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.549051 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.549178 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.549356 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.549442 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.549661 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.549752 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.549965 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.550051 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.550267 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.550358 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.550571 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.550661 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.550870 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.550962 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.551169 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.551253 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.551471 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.551563 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.551771 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.551861 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.552070 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.552153 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.552369 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.552460 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.552666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.552788 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.552988 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.553073 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.553291 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.553388 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.553594 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.553678 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.553895 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.553980 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.554207 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.554299 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.554506 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.554591 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.554813 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.554899 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.555113 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.555199 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.555415 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.555500 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.555714 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.555805 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.556015 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.556099 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.556317 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.556402 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.556616 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.556701 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.556978 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.557065 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.557279 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.557398 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.557610 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.557694 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.557912 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.557997 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.558232 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.558337 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.558557 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.558649 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.558856 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.558940 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.559155 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.559238 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.559459 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.559551 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.559756 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.559846 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.560055 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.560139 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.560360 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.560457 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.560661 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.560744 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.560980 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.561075 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.561283 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.561376 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.561581 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.561672 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.561886 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.561970 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.562185 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.562276 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.562481 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.562566 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.562784 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.562869 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.563086 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.563171 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.563385 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.563476 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.563687 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.563776 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.563986 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.564071 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.564285 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.564376 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.564589 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.564673 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.564909 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.565010 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.565207 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.565291 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.565514 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.565608 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.565811 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.565901 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.566111 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.566208 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.566409 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.566501 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.566710 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.566794 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.567006 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.567090 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.567309 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.567400 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.567616 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.567709 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.567914 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.568006 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.568210 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.568306 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.568513 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.568597 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.568836 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.568939 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.569135 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.569221 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.569440 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.569527 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.569741 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.569826 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.570040 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.570126 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.570345 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.570428 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.570652 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.570735 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.570950 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.571037 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.571248 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.571332 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.571546 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.571629 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.571845 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.571936 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.572143 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.572233 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.572442 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.572533 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.572736 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.572893 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.573057 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.573142 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.573369 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.573859 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.574070 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.574197 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.574371 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.574471 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.574671 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.574781 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.574972 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.575061 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.575271 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.575359 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.575571 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.575666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.575876 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.575964 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.576176 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.576263 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.576516 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.576603 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.576843 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.576946 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.577161 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.577247 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.577474 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.577576 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.577784 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.577879 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.578091 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.578178 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.578392 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.578479 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.578697 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.578789 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.579001 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.579087 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.579320 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.579408 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.579602 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.579687 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.579900 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.579993 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.580216 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.580339 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.580518 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.580604 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.580843 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.580945 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.581165 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.581251 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.581476 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.581562 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.581784 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.581879 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.582082 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.582166 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.582387 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.582473 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.582692 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.582787 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.582994 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.583079 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.583296 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.583382 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.583601 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.583709 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.583901 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.584009 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.584207 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.584301 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.584508 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.584595 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.584833 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.584930 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.585136 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.585222 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.585436 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.585532 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.585741 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.585828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.586042 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.586129 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.586339 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.586426 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.586656 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.586742 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.586957 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.587043 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.587256 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.587349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.587557 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.587643 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.587857 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.587958 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.588162 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.588255 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.588460 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.588546 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.588849 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.588952 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.589102 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.589189 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.589404 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.589489 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.589804 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.589899 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.590110 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.590195 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.590438 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.590529 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.590755 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.590855 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.591064 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.591149 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.591363 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.591447 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.591673 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.591759 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.591983 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.592070 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.592285 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.592372 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.592646 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.592733 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.592987 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.593093 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.593287 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.593374 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.593611 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.593696 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.593891 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.593991 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.594187 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.594272 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.594486 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.594571 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.594785 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.594933 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.595088 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.595187 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.595386 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.595472 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.595689 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.595782 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.596005 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.596101 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.596308 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.596395 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.596624 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.596716 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.597061 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.597162 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.597370 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.597456 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.597672 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.597771 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.597991 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.598087 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.598310 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.598414 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.598633 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.598726 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.598936 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.599029 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.599246 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.599347 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.599552 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.599638 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.599859 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.599950 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.600169 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.600256 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.600470 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.600555 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.600794 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.600895 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.601096 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.601191 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.601407 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.601492 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.601717 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.601804 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.602018 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.602105 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.602331 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.602416 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.602644 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.602736 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.602953 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.603040 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.603271 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.603358 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.603644 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.603738 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.603963 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.604052 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.604265 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.604350 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.604566 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.604660 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.604898 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.604987 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.605245 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.605339 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.605548 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.605649 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.605866 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.605952 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.606170 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.606256 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.606474 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.606568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.606778 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.606872 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.607078 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.607164 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.607378 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.607471 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.607678 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.607765 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.607981 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.608074 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.608280 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.608367 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.608578 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.608663 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.608917 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.609016 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.609223 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.609316 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.609537 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.609675 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.609839 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.609926 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.610156 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.610284 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.610457 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.610551 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.610754 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.610848 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.611050 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.611148 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.611347 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.611434 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.611649 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.611748 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.611952 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.612039 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.612255 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.612340 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.612580 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.612673 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.612907 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.612997 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.613227 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.613327 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.613554 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.613741 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.613882 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.613998 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.614192 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.614306 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.614495 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.614588 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.614810 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.614903 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.615128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.615226 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.615429 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.615522 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.615730 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.615833 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.616033 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.616124 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.616332 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.616426 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.616631 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.616722 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.616958 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.617137 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.617260 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.617345 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.617558 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.617641 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.617855 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.617949 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.618153 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.618246 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.618449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.618543 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.618752 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.618845 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.619057 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.619142 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.619359 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.619442 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.619662 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.619779 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.619958 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.620046 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.620253 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.620340 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.620552 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.620647 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.621094 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.621198 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.621280 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.621359 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.621524 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.621848 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.621948 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.622153 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.622238 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.622460 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.622556 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.622772 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.622865 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.623086 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.623171 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.623397 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.623491 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.623709 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.623794 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.624018 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.624103 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.624323 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.624418 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.624634 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.624734 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.624965 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.625050 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.625278 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.625364 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.625586 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.625803 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.625889 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.626132 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.626225 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.626444 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.626535 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.626753 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.627007 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.627093 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.627342 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.627428 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.627651 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.627735 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.627959 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.628051 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.628266 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.628358 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.628573 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.628668 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.628903 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.629015 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.629224 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.629316 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.629535 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.629628 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.629846 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.629947 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.630156 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.630249 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.630468 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.630639 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.630775 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.630905 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.631072 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.631205 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.631378 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.631509 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.631707 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.631838 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.632022 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.632155 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.632325 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.632468 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.632634 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.632799 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.632974 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.633059 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.633287 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.633383 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.633595 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.633680 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.633901 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.633987 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.634209 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.634308 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.634516 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.634638 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.634822 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.634907 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.635127 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.635213 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.635434 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.635526 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.635740 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.635833 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.636045 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.636139 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.636351 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.636483 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.636727 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.636831 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.637061 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.637147 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.637372 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.637456 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.637685 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.637778 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.638004 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.638199 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.638326 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.638513 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.638606 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.638844 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.638938 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.639168 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.639414 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.639499 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.639723 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.639820 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.640053 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.640139 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.640374 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.640460 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.640682 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.640785 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.641011 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.641096 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.641318 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.641402 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.641623 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.641744 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.641925 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.642011 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.642229 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.642320 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.642533 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.642618 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.642837 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.642927 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.643139 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.643232 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.643454 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.643576 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.643746 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.643964 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.644050 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.644306 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.644400 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.644617 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.644736 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.644965 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.645181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.645276 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.645525 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.645611 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.645839 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.645924 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.646160 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.646252 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.646475 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.646560 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.646778 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.646863 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.647079 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.647171 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.647383 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.647468 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.647684 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.647770 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.647984 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.648068 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.648290 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.648381 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.648592 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.648684 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.648917 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.649005 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.649223 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.649314 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.649523 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.649608 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.649829 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.649921 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.650130 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.650215 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.650428 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.650512 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.650730 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.650816 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.651034 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.651124 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.651334 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.651427 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.651634 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.651718 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.651933 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.652046 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.652254 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.652348 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.652552 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.652644 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.652876 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.653011 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.653178 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.653345 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.653477 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.653568 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.653781 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.653864 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.654078 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.654170 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.654383 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.654468 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.654685 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.654770 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.654995 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.655089 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.655295 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.655379 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.655596 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.655692 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.655907 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.655993 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.656210 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.656296 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.656511 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.656596 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.656846 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.656936 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.657142 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.657226 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.657447 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.657538 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.657763 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.657857 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.658071 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.658289 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.658382 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.658622 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.658708 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.658950 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.659043 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.659279 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.659523 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.659616 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.659858 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.659950 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.660181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.660266 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.660479 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.660576 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.660825 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.660913 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.661135 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.661230 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.661447 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.661545 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.661752 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.661836 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.662055 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.662140 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.662362 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.662449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.662667 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.662754 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.662972 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.663056 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.663275 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.663360 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.663579 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.663671 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.663881 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.663967 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.664184 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.664270 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.664487 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.664584 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.664810 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.664949 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.665117 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.665204 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.665420 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.665504 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.665730 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.665834 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.666034 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.666119 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.666340 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.666426 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.666646 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.666738 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.666957 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.667042 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.667264 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.667349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.667572 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.667685 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.667931 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.668025 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.668234 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.668328 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.668544 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.668637 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.668876 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.668966 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.669192 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.669289 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.669492 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.669576 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.669803 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.670131 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.670235 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.670445 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.670531 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.670748 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.670834 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.671065 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.671371 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.671463 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.671693 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.671780 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.672013 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.672136 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.672319 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.672420 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.672635 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.672719 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.672969 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.673056 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.673292 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.673386 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.673607 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.673692 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.673928 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.674020 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.674241 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.674327 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.674544 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.674636 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.674844 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.674930 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.675149 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.675238 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.675453 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.675539 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.675770 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.675889 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.676073 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.676172 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.676373 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.676476 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.676672 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.676801 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.676999 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.677108 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.677298 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.677393 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.677595 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.677699 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.677896 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.677992 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.678191 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.678292 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.678495 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.678607 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.678793 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.678879 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.679094 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.679181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.679393 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.679485 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.679690 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.679774 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.679988 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.680073 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.680285 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.680414 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.680582 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.680712 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.680904 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.680992 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.681203 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.681289 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.681499 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.681593 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.681797 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.681890 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.682097 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.682193 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.682402 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.682493 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.682703 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.682787 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.683009 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.683096 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.683334 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.683422 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.683663 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.683754 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.683983 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.684068 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.684293 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.684376 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.684612 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.684747 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.684945 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.685030 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.685254 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.685337 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.685562 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.685660 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.685885 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.685988 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.686187 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.686273 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.686494 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.686581 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.686799 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.686883 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.687102 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.687186 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.687405 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.687491 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.687706 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.687791 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.688025 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.688109 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.688347 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.688439 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.688648 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.688732 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.689002 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.689092 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.689313 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.689401 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.689628 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.689712 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.689930 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.690026 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.690234 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.690318 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.690554 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.690644 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.690860 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.690951 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.691166 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.691258 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.691470 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.691555 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.691774 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.691871 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.692078 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.692170 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.692383 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.692468 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.692687 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.692832 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.693024 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.693109 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.693333 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.693427 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.693644 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.693729 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.693954 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.694046 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.694263 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.694348 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.694577 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.694663 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.694892 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.694985 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.695211 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.695304 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.695531 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.695616 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.695837 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.695937 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.696163 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.696267 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.696480 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.696568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.696817 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.696906 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.697128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.697231 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.697430 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.697515 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.697669 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 16:07:31.697755 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.698066 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.698376 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.699097 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:07:31.699338 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 16:07:31.854480 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO dbcounter [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Registered counter for database nova_api Sep 06 16:07:31.856573 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO dbcounter [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Registered counter for database nova_api Sep 06 16:07:31.877529 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_db.sqlalchemy.engines [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:07:31.879629 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG oslo_db.sqlalchemy.engines [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:07:31.885089 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writer thread running {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:07:31.887129 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG dbcounter [-] [105671] Writer thread running {{(pid=105671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:07:31.942404 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.context [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),862cff72-aa43-46ea-ad81-5a77b03254c2(cell1) {{(pid=105672) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 16:07:31.944096 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.context [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),862cff72-aa43-46ea-ad81-5a77b03254c2(cell1) {{(pid=105671) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 16:07:31.947576 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:07:31.947994 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG oslo_concurrency.lockutils [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:07:31.948194 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:07:31.948842 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG oslo_concurrency.lockutils [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:07:31.950185 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:07:31.950483 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG oslo_concurrency.lockutils [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:07:31.951195 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG oslo_concurrency.lockutils [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:07:31.951329 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:07:31.951623 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG oslo_concurrency.lockutils [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:07:31.951973 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:07:31.953635 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG oslo_concurrency.lockutils [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:07:31.954274 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:07:31.955644 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO dbcounter [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Registered counter for database nova_cell0 Sep 06 16:07:31.956301 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO dbcounter [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Registered counter for database nova_cell0 Sep 06 16:07:31.959851 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO dbcounter [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Registered counter for database nova_cell1 Sep 06 16:07:31.960389 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO dbcounter [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Registered counter for database nova_cell1 Sep 06 16:07:31.968049 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG oslo_db.sqlalchemy.engines [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:07:31.969751 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_db.sqlalchemy.engines [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:07:31.971501 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_db.sqlalchemy.engines [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:07:31.973587 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG dbcounter [-] [105671] Writer thread running {{(pid=105671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:07:31.974228 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG oslo_db.sqlalchemy.engines [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:07:31.978781 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writer thread running {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:07:31.980281 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writer thread running {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:07:32.112441 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG dbcounter [-] [105671] Writer thread running {{(pid=105671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:07:32.121892 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO dbcounter [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Registered counter for database nova_cell0 Sep 06 16:07:32.125092 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO dbcounter [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Registered counter for database nova_cell0 Sep 06 16:07:32.131284 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG oslo_db.sqlalchemy.engines [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:07:32.134884 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_db.sqlalchemy.engines [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:07:32.136663 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG dbcounter [-] [105671] Writer thread running {{(pid=105671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:07:32.139639 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writer thread running {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:07:32.473059 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: WARNING keystonemiddleware.auth_token [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:07:32.477349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: WARNING keystonemiddleware.auth_token [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:07:32.480369 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: WARNING keystonemiddleware.auth_token [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:07:32.484600 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: WARNING keystonemiddleware.auth_token [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:07:32.820476 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: WARNING keystonemiddleware.auth_token [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:07:32.826660 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: WARNING keystonemiddleware.auth_token [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:07:32.826826 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: WARNING keystonemiddleware.auth_token [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:07:32.832098 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562a1df3c9c0 pid: 105672 (default app) Sep 06 16:07:32.832569 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: WARNING keystonemiddleware.auth_token [None req-6cc7448a-bb79-4ad7-a5a5-e9934d51466a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:07:32.834373 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:32.835592 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001933 Sep 06 16:07:32.835979 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Tue Sep 6 16:07:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:07:32.837903 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562a1df3c9c0 pid: 105671 (default app) Sep 06 16:08:50.453152 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:50.454038 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 06 16:08:50.454629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:08:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:08:50.467187 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG dbcounter [-] [105671] Writing DB stats nova_api:SELECT=3 {{(pid=105671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:08:50.468358 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG dbcounter [-] [105671] Writing DB stats nova_cell1:SELECT=3 {{(pid=105671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:08:50.469361 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG dbcounter [-] [105671] Writing DB stats nova_cell0:SELECT=3 {{(pid=105671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:08:50.470084 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG dbcounter [-] [105671] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:08:51.334265 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-1b48fe40-36ee-4c08-ba7f-0e75389428e9 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:51.366478 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-1b48fe40-36ee-4c08-ba7f-0e75389428e9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904537 Sep 06 16:08:51.373780 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Sep 6 16:08:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:08:53.703819 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:53.705535 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-dd0a091b-2006-4a21-8f1d-b895317b0858 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 06 16:08:53.705535 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:08:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:08:54.142932 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-4a8e5ee4-b4d7-4da2-9da9-c7bc68054f75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "disk": 1, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:08:54.190784 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-4a8e5ee4-b4d7-4da2-9da9-c7bc68054f75 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.475929 Sep 06 16:08:54.191563 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 6 16:08:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:08:54.205613 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writing DB stats nova_api:SELECT=3 {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:08:54.206464 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writing DB stats nova_cell0:SELECT=3 {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:08:54.207507 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writing DB stats nova_cell1:SELECT=3 {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:08:54.208308 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:08:54.417093 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-36610693-6487-4e7f-91b0-4554a47bb63f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:08:54.479501 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-36610693-6487-4e7f-91b0-4554a47bb63f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278657 Sep 06 16:08:54.480326 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Sep 6 16:08:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:08:56.787079 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-4a8e5ee4-b4d7-4da2-9da9-c7bc68054f75 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:56.788792 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-4a8e5ee4-b4d7-4da2-9da9-c7bc68054f75 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Sep 06 16:08:56.789136 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:08:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:08:57.444340 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-56ece180-695f-40d1-a10d-97f7e8bbe251 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "swap": 0, "name": "ds512M"}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:08:57.485099 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-56ece180-695f-40d1-a10d-97f7e8bbe251 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.689620 Sep 06 16:08:57.486211 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 6 16:08:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 16:08:57.498095 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-dc6e0505-3433-4635-b58d-75d814d881cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:08:57.535614 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-dc6e0505-3433-4635-b58d-75d814d881cb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041191 Sep 06 16:08:57.536672 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Sep 6 16:08:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:08:59.859381 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-56ece180-695f-40d1-a10d-97f7e8bbe251 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:59.860459 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-56ece180-695f-40d1-a10d-97f7e8bbe251 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 06 16:08:59.860862 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:00.275221 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-64822e5b-a0b8-4fcb-9b6d-1c6c24de5b49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:00.292594 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-64822e5b-a0b8-4fcb-9b6d-1c6c24de5b49 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425548 Sep 06 16:09:00.293182 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 6 16:08:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:09:00.305397 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-aa12bb2b-68bf-4e4a-b473-921020cb0021 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:00.329762 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-aa12bb2b-68bf-4e4a-b473-921020cb0021 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028017 Sep 06 16:09:00.330458 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Sep 6 16:09:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:09:02.708040 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-64822e5b-a0b8-4fcb-9b6d-1c6c24de5b49 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:02.709312 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-64822e5b-a0b8-4fcb-9b6d-1c6c24de5b49 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001820 Sep 06 16:09:02.709768 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:09:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:03.297981 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-c90078c7-4048-476e-babd-8fb063bd9797 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "disk": 10, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:03.320199 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-c90078c7-4048-476e-babd-8fb063bd9797 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.603513 Sep 06 16:09:03.329163 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 6 16:09:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 16:09:03.333493 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-171a72a3-cda2-414d-8ba6-cde5db293ab0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:03.362101 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-171a72a3-cda2-414d-8ba6-cde5db293ab0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032295 Sep 06 16:09:03.362678 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Sep 6 16:09:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:09:05.696160 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-c90078c7-4048-476e-babd-8fb063bd9797 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:05.697733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-c90078c7-4048-476e-babd-8fb063bd9797 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 Sep 06 16:09:05.700797 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:09:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:06.124659 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-eca459f7-e262-4b48-b242-8131746fecaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "swap": 0, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:06.145244 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-eca459f7-e262-4b48-b242-8131746fecaf admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440621 Sep 06 16:09:06.146581 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 6 16:09:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:09:06.158838 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-b7b0aed8-48f7-4473-88f7-179f3c73065e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:06.183189 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-b7b0aed8-48f7-4473-88f7-179f3c73065e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027998 Sep 06 16:09:06.183776 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1336 bytes} [Tue Sep 6 16:09:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:09:08.549544 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-eca459f7-e262-4b48-b242-8131746fecaf admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:08.550483 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-eca459f7-e262-4b48-b242-8131746fecaf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Sep 06 16:09:08.550901 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:09:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:08.983098 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-91857f0d-8449-4f38-a0cb-6d3715f98fa9 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:09.008281 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-91857f0d-8449-4f38-a0cb-6d3715f98fa9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.451044 Sep 06 16:09:09.008861 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Sep 6 16:09:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:09:11.372398 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-eca459f7-e262-4b48-b242-8131746fecaf admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:11.373803 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-eca459f7-e262-4b48-b242-8131746fecaf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002228 Sep 06 16:09:11.374409 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:09:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:11.865591 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-85421e74-ede7-430f-b024-2613572ad307 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "id": "1", "name": "m1.tiny", "disk": 1}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:11.889701 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-85421e74-ede7-430f-b024-2613572ad307 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.508342 Sep 06 16:09:11.890450 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 6 16:09:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:09:11.903650 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-02dc22a7-35eb-4721-a4e9-6dc5384e45d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:11.932904 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-02dc22a7-35eb-4721-a4e9-6dc5384e45d9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033456 Sep 06 16:09:11.933600 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Sep 6 16:09:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:09:14.301178 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-85421e74-ede7-430f-b024-2613572ad307 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:14.302218 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-85421e74-ede7-430f-b024-2613572ad307 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 06 16:09:14.302595 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:09:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:14.694505 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-1d8733b4-9a1a-465a-a24b-3539ddddd8e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:14.716006 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-1d8733b4-9a1a-465a-a24b-3539ddddd8e8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.406540 Sep 06 16:09:14.716585 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 6 16:09:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:09:14.728844 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-db56611d-a25c-4efe-92bc-e111158a81ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:14.754044 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-db56611d-a25c-4efe-92bc-e111158a81ef admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028868 Sep 06 16:09:14.754734 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Sep 6 16:09:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:09:17.104383 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-1d8733b4-9a1a-465a-a24b-3539ddddd8e8 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:17.104383 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-1d8733b4-9a1a-465a-a24b-3539ddddd8e8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 06 16:09:17.104383 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:17.472237 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-8dab5c14-8dac-4c96-bf7d-f43f46327647 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "disk": 40}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:17.497768 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-8dab5c14-8dac-4c96-bf7d-f43f46327647 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.393819 Sep 06 16:09:17.498599 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 6 16:09:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:09:17.510521 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-64b641d6-611d-4c36-a386-c63fa19dd796 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:17.543294 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-64b641d6-611d-4c36-a386-c63fa19dd796 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036485 Sep 06 16:09:17.544464 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Sep 6 16:09:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:09:19.913023 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-8dab5c14-8dac-4c96-bf7d-f43f46327647 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:19.914062 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-8dab5c14-8dac-4c96-bf7d-f43f46327647 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 06 16:09:19.914597 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:09:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:20.350575 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-0809d307-5051-4e1b-88ea-227d6e234e4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "ram": 8192}} {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:20.371231 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-0809d307-5051-4e1b-88ea-227d6e234e4f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450342 Sep 06 16:09:20.376840 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 6 16:09:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:09:20.394166 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-8fa8c1e6-4afe-40ee-92d4-dfcf29f94c5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:20.420916 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-8fa8c1e6-4afe-40ee-92d4-dfcf29f94c5e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030700 Sep 06 16:09:20.421798 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Sep 6 16:09:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:09:22.792018 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-0809d307-5051-4e1b-88ea-227d6e234e4f admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:22.793636 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-0809d307-5051-4e1b-88ea-227d6e234e4f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002433 Sep 06 16:09:22.796793 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:09:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:23.235416 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-1320648f-278c-42fc-9d67-0c475a952c4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "disk": 160}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:23.335718 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-1320648f-278c-42fc-9d67-0c475a952c4a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.535076 Sep 06 16:09:23.337505 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1283 bytes} [Tue Sep 6 16:09:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:09:23.348618 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-df03ced5-d4de-4359-b823-00a6c21d2eb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:23.356248 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG dbcounter [-] [105671] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:09:23.378336 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-df03ced5-d4de-4359-b823-00a6c21d2eb8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033503 Sep 06 16:09:23.379534 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1333 bytes} [Tue Sep 6 16:09:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:09:41.907200 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-1320648f-278c-42fc-9d67-0c475a952c4a admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:41.908823 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-1320648f-278c-42fc-9d67-0c475a952c4a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002274 Sep 06 16:09:41.909442 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:09:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:42.329599 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-38872ece-6eb8-4ce4-a296-94ce32c4644e admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:42.350446 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-38872ece-6eb8-4ce4-a296-94ce32c4644e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.431733 Sep 06 16:09:42.350976 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Sep 6 16:09:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:09:43.405678 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-1320648f-278c-42fc-9d67-0c475a952c4a admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:43.406803 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-1320648f-278c-42fc-9d67-0c475a952c4a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Sep 06 16:09:43.407191 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 6 16:09:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:43.976881 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-b4e44ee6-093e-4fc5-86b4-e567b158e073 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:43.983134 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.wsgi [None req-b4e44ee6-093e-4fc5-86b4-e567b158e073 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-b4e44ee6-093e-4fc5-86b4-e567b158e073 admin admin] Request method failure captured: Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Accept: application/json Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Accept-Encoding: gzip, deflate Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Connection: keep-alive Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Content-Length: 0 Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Host: 10.222.0.43 Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Openstack-Api-Version: compute 2.92 Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Openstack-System-Scope: None Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: User-Agent: python-novaclient Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Auth-Token: gAAAAABjF3DHGu_A5s0ehS_PmyqR2aIuMKcu4q7DJYsUctfh2Vp4HMbzTj9ozPog4NXSjSPAfO0x37udofwwzcibakiBgs0Bk94jafkq1E1jeMNKBNXLh_MBO3QDhAaJRH85k9h0U1uGSKv0UFX3nLhZ7T2kRDUwqKWY_xIRzz-iWUdwiMYTqJQ Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Domain-Id: None Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Domain-Name: None Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Identity-Status: Confirmed Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Is-Admin-Project: True Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Project-Domain-Id: default Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Project-Domain-Name: Default Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Project-Id: 0ad262a5a8a84066b8eba54c7ea32d39 Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Project-Name: admin Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Role: reader,member,admin Sep 06 16:09:43.986449 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Roles: reader,member,admin Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Tenant: admin Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Tenant-Id: 0ad262a5a8a84066b8eba54c7ea32d39 Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Tenant-Name: admin Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User: admin Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User-Domain-Id: default Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User-Domain-Name: Default Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User-Id: 824c9880f41b4962b83243abf75b8162 Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User-Name: admin Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: method: > Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: exception: Flavor 42 could not be found. Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: action_args: {'id': '42'} Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:09:43.987875 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:09:43.989828 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:43.991211 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-b4e44ee6-093e-4fc5-86b4-e567b158e073 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:09:43.992243 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-b4e44ee6-093e-4fc5-86b4-e567b158e073 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.446002 Sep 06 16:09:43.992243 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Sep 6 16:09:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 16:09:43.997797 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-d6b31ca2-ecbe-4eb4-8c94-c392df840be4 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:44.001996 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:09:44.020735 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-d6b31ca2-ecbe-4eb4-8c94-c392df840be4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026619 Sep 06 16:09:44.021290 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Sep 6 16:09:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:09:44.033632 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-cc370d3d-8a41-4156-b63c-39aa55166ca9 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:44.064424 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-cc370d3d-8a41-4156-b63c-39aa55166ca9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.036459 Sep 06 16:09:44.064970 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Sep 6 16:09:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:09:44.077380 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-01662412-91d6-437f-a216-7fa088d5aa41 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:44.086390 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.wsgi [None req-01662412-91d6-437f-a216-7fa088d5aa41 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-01662412-91d6-437f-a216-7fa088d5aa41 admin admin] Request method failure captured: Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Accept: application/json Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Accept-Encoding: gzip, deflate Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Connection: keep-alive Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Content-Length: 0 Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Host: 10.222.0.43 Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Openstack-Api-Version: compute 2.92 Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Openstack-System-Scope: None Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: User-Agent: python-novaclient Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Auth-Token: gAAAAABjF3DHGu_A5s0ehS_PmyqR2aIuMKcu4q7DJYsUctfh2Vp4HMbzTj9ozPog4NXSjSPAfO0x37udofwwzcibakiBgs0Bk94jafkq1E1jeMNKBNXLh_MBO3QDhAaJRH85k9h0U1uGSKv0UFX3nLhZ7T2kRDUwqKWY_xIRzz-iWUdwiMYTqJQ Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Domain-Id: None Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Domain-Name: None Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Identity-Status: Confirmed Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Is-Admin-Project: True Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Project-Domain-Id: default Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Project-Domain-Name: Default Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Project-Id: 0ad262a5a8a84066b8eba54c7ea32d39 Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Project-Name: admin Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Role: reader,member,admin Sep 06 16:09:44.090666 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Roles: reader,member,admin Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Tenant: admin Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Tenant-Id: 0ad262a5a8a84066b8eba54c7ea32d39 Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Tenant-Name: admin Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User: admin Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User-Domain-Id: default Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User-Domain-Name: Default Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User-Id: 824c9880f41b4962b83243abf75b8162 Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User-Name: admin Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: method: > Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: exception: Flavor 42 could not be found. Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: action_args: {'id': '42'} Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:09:44.092043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:09:44.092956 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:44.094128 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-01662412-91d6-437f-a216-7fa088d5aa41 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:09:44.095253 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-01662412-91d6-437f-a216-7fa088d5aa41 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.020884 Sep 06 16:09:44.095253 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Sep 6 16:09:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 16:09:45.087745 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-cc370d3d-8a41-4156-b63c-39aa55166ca9 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:45.088851 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-cc370d3d-8a41-4156-b63c-39aa55166ca9 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 06 16:09:45.089221 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 6 16:09:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:45.641489 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-c2594f8e-1c72-47a5-ab46-f8b2ca7bbbe5 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:45.647001 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.wsgi [None req-c2594f8e-1c72-47a5-ab46-f8b2ca7bbbe5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-c2594f8e-1c72-47a5-ab46-f8b2ca7bbbe5 admin admin] Request method failure captured: Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Accept: application/json Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Accept-Encoding: gzip, deflate Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Connection: keep-alive Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Content-Length: 0 Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Host: 10.222.0.43 Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Openstack-Api-Version: compute 2.92 Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Openstack-System-Scope: None Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: User-Agent: python-novaclient Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Auth-Token: gAAAAABjF3DIDzdtPNu0tWPbRHlm1OBitdpap8c8b0qar_1HCVUq3je3uYSMG6-bkuneHlgXIPO4jajUk2OBAyX0rOnZJWgE6ah0LyCWURKVnaZkABg6At0Ozxp9O7PO2IiJQQpE0tHTobsjDSPYGhuHVhlFUoDs81NrWb1W79fTwGV-5J4u6tQ Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Domain-Id: None Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Domain-Name: None Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Identity-Status: Confirmed Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Is-Admin-Project: True Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Project-Domain-Id: default Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Project-Domain-Name: Default Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Project-Id: 0ad262a5a8a84066b8eba54c7ea32d39 Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Project-Name: admin Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Role: reader,member,admin Sep 06 16:09:45.648484 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Roles: reader,member,admin Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Tenant: admin Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Tenant-Id: 0ad262a5a8a84066b8eba54c7ea32d39 Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Tenant-Name: admin Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User: admin Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User-Domain-Id: default Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User-Domain-Name: Default Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User-Id: 824c9880f41b4962b83243abf75b8162 Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User-Name: admin Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: method: > Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: exception: Flavor 84 could not be found. Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: action_args: {'id': '84'} Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:09:45.649856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:09:45.650629 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:45.651733 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-c2594f8e-1c72-47a5-ab46-f8b2ca7bbbe5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:09:45.653033 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-c2594f8e-1c72-47a5-ab46-f8b2ca7bbbe5 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.424139 Sep 06 16:09:45.653033 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Sep 6 16:09:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 16:09:45.663042 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-314f4c80-42f0-4e09-a822-c6cbe2610e05 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:45.679539 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-314f4c80-42f0-4e09-a822-c6cbe2610e05 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022265 Sep 06 16:09:45.680050 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Sep 6 16:09:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:09:45.689379 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-96e7366d-01b2-4cd5-b202-0435e2f1f0d6 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:45.704846 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-96e7366d-01b2-4cd5-b202-0435e2f1f0d6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018942 Sep 06 16:09:45.705342 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Sep 6 16:09:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:09:45.714372 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-624274b7-ad1d-43cf-90d1-14e207c725e6 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:45.719660 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.wsgi [None req-624274b7-ad1d-43cf-90d1-14e207c725e6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-624274b7-ad1d-43cf-90d1-14e207c725e6 admin admin] Request method failure captured: Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Accept: application/json Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Accept-Encoding: gzip, deflate Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Connection: keep-alive Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Content-Length: 0 Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Host: 10.222.0.43 Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Openstack-Api-Version: compute 2.92 Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Openstack-System-Scope: None Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: User-Agent: python-novaclient Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Auth-Token: gAAAAABjF3DIDzdtPNu0tWPbRHlm1OBitdpap8c8b0qar_1HCVUq3je3uYSMG6-bkuneHlgXIPO4jajUk2OBAyX0rOnZJWgE6ah0LyCWURKVnaZkABg6At0Ozxp9O7PO2IiJQQpE0tHTobsjDSPYGhuHVhlFUoDs81NrWb1W79fTwGV-5J4u6tQ Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Domain-Id: None Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Domain-Name: None Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Identity-Status: Confirmed Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Is-Admin-Project: True Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Project-Domain-Id: default Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Project-Domain-Name: Default Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Project-Id: 0ad262a5a8a84066b8eba54c7ea32d39 Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Project-Name: admin Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Role: reader,member,admin Sep 06 16:09:45.721181 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Roles: reader,member,admin Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Tenant: admin Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Tenant-Id: 0ad262a5a8a84066b8eba54c7ea32d39 Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Tenant-Name: admin Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User: admin Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User-Domain-Id: default Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User-Domain-Name: Default Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User-Id: 824c9880f41b4962b83243abf75b8162 Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User-Name: admin Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: method: > Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: exception: Flavor 84 could not be found. Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: action_args: {'id': '84'} Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:09:45.723196 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:09:45.724299 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:45.726149 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-624274b7-ad1d-43cf-90d1-14e207c725e6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:09:45.727552 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-624274b7-ad1d-43cf-90d1-14e207c725e6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011646 Sep 06 16:09:45.727552 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Sep 6 16:09:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 16:09:46.695488 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-96e7366d-01b2-4cd5-b202-0435e2f1f0d6 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:46.696889 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-96e7366d-01b2-4cd5-b202-0435e2f1f0d6 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001802 Sep 06 16:09:46.697248 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 6 16:09:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:47.279335 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-55cdea1d-6865-419a-a498-549f03a22598 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:47.285349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.wsgi [None req-55cdea1d-6865-419a-a498-549f03a22598 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-55cdea1d-6865-419a-a498-549f03a22598 admin admin] Request method failure captured: Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Accept: application/json Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Accept-Encoding: gzip, deflate Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Connection: keep-alive Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Content-Length: 0 Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Host: 10.222.0.43 Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Openstack-Api-Version: compute 2.92 Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Openstack-System-Scope: None Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: User-Agent: python-novaclient Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Auth-Token: gAAAAABjF3DKBMk7oYp-XfrtTGFIOjHO-BkI3NndzwJw3uCrcFNyq_AuWVXeRts6Q32LEHdGX8kbw2j4rmGAjRWVd__KKlM0LBGbBOB7AAtd7-iJIfdP_ToLhpBykquWTBTMfQyEa_pnBFCAGGmu9Gg_6qPEOxWO4d6-tb3s2pvZqxtILaZYAdI Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Domain-Id: None Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Domain-Name: None Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Identity-Status: Confirmed Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Is-Admin-Project: True Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Project-Domain-Id: default Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Project-Domain-Name: Default Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Project-Id: 0ad262a5a8a84066b8eba54c7ea32d39 Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Project-Name: admin Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Role: reader,member,admin Sep 06 16:09:47.286847 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Roles: reader,member,admin Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Tenant: admin Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Tenant-Id: 0ad262a5a8a84066b8eba54c7ea32d39 Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-Tenant-Name: admin Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User: admin Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User-Domain-Id: default Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User-Domain-Name: Default Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User-Id: 824c9880f41b4962b83243abf75b8162 Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: X-User-Name: admin Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: method: > Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: exception: Flavor 451 could not be found. Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: action_args: {'id': '451'} Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:09:47.288349 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:09:47.289323 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: ERROR nova.api.openstack.wsgi Sep 06 16:09:47.290568 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-55cdea1d-6865-419a-a498-549f03a22598 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:09:47.291837 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-55cdea1d-6865-419a-a498-549f03a22598 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.448247 Sep 06 16:09:47.291837 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Sep 6 16:09:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 16:09:47.298080 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-70d0c05b-0bc3-4d59-9365-e147079ce59f admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:47.313253 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-70d0c05b-0bc3-4d59-9365-e147079ce59f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018722 Sep 06 16:09:47.313944 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Sep 6 16:09:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:09:47.323758 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:47.338687 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018916 Sep 06 16:09:47.339192 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Sep 6 16:09:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:09:47.348437 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-0e54107c-bb9d-465c-89a7-7866437f390c admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:47.353972 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.wsgi [None req-0e54107c-bb9d-465c-89a7-7866437f390c admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-0e54107c-bb9d-465c-89a7-7866437f390c admin admin] Request method failure captured: Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Accept: application/json Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Accept-Encoding: gzip, deflate Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Connection: keep-alive Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Content-Length: 0 Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Host: 10.222.0.43 Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Openstack-Api-Version: compute 2.92 Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Openstack-System-Scope: None Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: User-Agent: python-novaclient Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Auth-Token: gAAAAABjF3DKBMk7oYp-XfrtTGFIOjHO-BkI3NndzwJw3uCrcFNyq_AuWVXeRts6Q32LEHdGX8kbw2j4rmGAjRWVd__KKlM0LBGbBOB7AAtd7-iJIfdP_ToLhpBykquWTBTMfQyEa_pnBFCAGGmu9Gg_6qPEOxWO4d6-tb3s2pvZqxtILaZYAdI Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Domain-Id: None Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Domain-Name: None Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Identity-Status: Confirmed Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Is-Admin-Project: True Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Project-Domain-Id: default Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Project-Domain-Name: Default Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Project-Id: 0ad262a5a8a84066b8eba54c7ea32d39 Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Project-Name: admin Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Role: reader,member,admin Sep 06 16:09:47.355526 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Roles: reader,member,admin Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ad262a5a8a84066b8eba54c7ea32d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Tenant: admin Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Tenant-Id: 0ad262a5a8a84066b8eba54c7ea32d39 Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-Tenant-Name: admin Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User: admin Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User-Domain-Id: default Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User-Domain-Name: Default Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User-Id: 824c9880f41b4962b83243abf75b8162 Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: X-User-Name: admin Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: method: > Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: exception: Flavor 451 could not be found. Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: action_args: {'id': '451'} Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:09:47.357037 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:09:47.357902 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: ERROR nova.api.openstack.wsgi Sep 06 16:09:47.358939 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-0e54107c-bb9d-465c-89a7-7866437f390c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:09:47.360027 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-0e54107c-bb9d-465c-89a7-7866437f390c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011939 Sep 06 16:09:47.360027 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Sep 6 16:09:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 16:09:48.353244 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:48.354792 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002280 Sep 06 16:09:48.355371 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 6 16:09:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:48.940428 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-559c00ef-c15d-41c6-a825-dc720e9b49ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:48.966471 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-559c00ef-c15d-41c6-a825-dc720e9b49ce admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.456018 Sep 06 16:09:48.967060 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Sep 6 16:09:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:09:49.941043 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:49.942064 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 06 16:09:49.942623 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 6 16:09:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:50.517907 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-06fcfab0-404a-406e-9399-7093fe27d292 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:50.538323 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-06fcfab0-404a-406e-9399-7093fe27d292 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.456695 Sep 06 16:09:50.538893 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Sep 6 16:09:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:09:51.519991 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:51.521025 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 06 16:09:51.521411 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 6 16:09:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:52.084061 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-75f3eafe-3977-4e9f-be42-a6f574f0c027 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:52.112125 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-75f3eafe-3977-4e9f-be42-a6f574f0c027 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.455973 Sep 06 16:09:52.112869 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Sep 6 16:09:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:09:53.130221 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:53.131532 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Sep 06 16:09:53.131911 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 6 16:09:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:53.667386 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-8c127323-6717-41e9-a390-7b26afc3f4ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:09:53.689888 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-8c127323-6717-41e9-a390-7b26afc3f4ef admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.425148 Sep 06 16:09:53.690433 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Sep 6 16:09:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:09:54.685269 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:54.686617 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Sep 06 16:09:54.687118 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 6 16:09:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:55.252223 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-bfa1f1ac-7a41-443c-9fe5-ba5944cfefd3 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:55.273137 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-bfa1f1ac-7a41-443c-9fe5-ba5944cfefd3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.442366 Sep 06 16:09:55.273667 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Tue Sep 6 16:09:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:10:48.761058 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:10:48.762030 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-7bda365c-578f-47cc-b882-fea2beb9fba6 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001920 Sep 06 16:10:48.762395 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 931 bytes} [Tue Sep 6 16:10:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:10:48.773350 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:10:49.182728 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-212dd0e1-ab5f-48a4-b7ae-9e9c1cc204a9 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:10:49.203824 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-212dd0e1-ab5f-48a4-b7ae-9e9c1cc204a9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.435013 Sep 06 16:10:49.204360 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1292 bytes} [Tue Sep 6 16:10:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:10:49.225283 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG dbcounter [-] [105671] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:10:49.229150 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-351c082f-3817-40e1-8c54-02db75b7e86d admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:10:49.237617 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-351c082f-3817-40e1-8c54-02db75b7e86d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013820 Sep 06 16:10:49.238159 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1283 bytes} [Tue Sep 6 16:10:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:10:49.250288 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-c42cb0d9-e716-4aa2-a6f8-0e91ef2b7c74 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:10:49.258283 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-c42cb0d9-e716-4aa2-a6f8-0e91ef2b7c74 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011600 Sep 06 16:10:49.258795 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1286 bytes} [Tue Sep 6 16:10:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:10:49.270815 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-e0cf3204-4f63-4a1c-8eeb-730c1ca2ae6b admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:10:49.281234 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-e0cf3204-4f63-4a1c-8eeb-730c1ca2ae6b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014083 Sep 06 16:10:49.282054 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1286 bytes} [Tue Sep 6 16:10:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:10:49.295201 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-77685fbb-917f-4f3d-b6c0-6bb93b8dcc85 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:10:49.303254 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-77685fbb-917f-4f3d-b6c0-6bb93b8dcc85 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012029 Sep 06 16:10:49.303809 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1283 bytes} [Tue Sep 6 16:10:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:13:48.779329 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-e0cf3204-4f63-4a1c-8eeb-730c1ca2ae6b admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:13:48.780367 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-e0cf3204-4f63-4a1c-8eeb-730c1ca2ae6b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 06 16:13:48.780776 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 6 16:13:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:13:48.925913 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writing DB stats nova_api:SELECT=6 {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:13:49.116640 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-92db26d8-28e4-46d1-a923-671406d55041 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:13:49.121305 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-92db26d8-28e4-46d1-a923-671406d55041 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:13:49.121760 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-92db26d8-28e4-46d1-a923-671406d55041 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:13:49.122176 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-92db26d8-28e4-46d1-a923-671406d55041 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:13:49.122856 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-92db26d8-28e4-46d1-a923-671406d55041 admin admin] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:13:49.123282 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-92db26d8-28e4-46d1-a923-671406d55041 admin admin] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:13:49.123686 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-92db26d8-28e4-46d1-a923-671406d55041 admin admin] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:13:49.157078 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-92db26d8-28e4-46d1-a923-671406d55041 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.233527 Sep 06 16:13:49.157625 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Sep 6 16:13:48 2022] GET /compute/v2.1/os-services => generated 794 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:13:49.998777 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-e0cf3204-4f63-4a1c-8eeb-730c1ca2ae6b admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:13:50.000078 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-e0cf3204-4f63-4a1c-8eeb-730c1ca2ae6b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Sep 06 16:13:50.000496 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 6 16:13:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:13:50.196930 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-017654fa-4b28-430d-b97d-069c0e718b12 admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:13:50.200377 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-017654fa-4b28-430d-b97d-069c0e718b12 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:13:50.200875 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-017654fa-4b28-430d-b97d-069c0e718b12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:13:50.201302 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-017654fa-4b28-430d-b97d-069c0e718b12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:13:50.202008 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-017654fa-4b28-430d-b97d-069c0e718b12 admin admin] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:13:50.202444 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-017654fa-4b28-430d-b97d-069c0e718b12 admin admin] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:13:50.202863 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-017654fa-4b28-430d-b97d-069c0e718b12 admin admin] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:13:50.222391 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-017654fa-4b28-430d-b97d-069c0e718b12 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.085681 Sep 06 16:13:50.222965 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Sep 6 16:13:50 2022] GET /compute/v2.1/os-services => generated 794 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:14:01.479934 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-e0cf3204-4f63-4a1c-8eeb-730c1ca2ae6b admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:01.480963 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-e0cf3204-4f63-4a1c-8eeb-730c1ca2ae6b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 06 16:14:01.481346 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 6 16:14:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:01.625443 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writing DB stats nova_cell0:SELECT=4 {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:01.626106 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writing DB stats nova_cell1:SELECT=4 {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:01.626804 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG dbcounter [-] [105672] Writing DB stats nova_api:SELECT=8 {{(pid=105672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:01.693866 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-e19683c2-2ce5-46cb-abc7-4fb36fe6deef admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:01.698060 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-e19683c2-2ce5-46cb-abc7-4fb36fe6deef admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:01.698530 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-e19683c2-2ce5-46cb-abc7-4fb36fe6deef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:01.698951 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-e19683c2-2ce5-46cb-abc7-4fb36fe6deef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:01.699648 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-e19683c2-2ce5-46cb-abc7-4fb36fe6deef admin admin] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:01.700084 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-e19683c2-2ce5-46cb-abc7-4fb36fe6deef admin admin] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:01.700492 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-e19683c2-2ce5-46cb-abc7-4fb36fe6deef admin admin] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:01.727491 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-e19683c2-2ce5-46cb-abc7-4fb36fe6deef admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.106708 Sep 06 16:14:01.728104 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Sep 6 16:14:01 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:14:02.614472 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: DEBUG nova.api.openstack.wsgi [None req-e0cf3204-4f63-4a1c-8eeb-730c1ca2ae6b admin admin] Calling method '>' {{(pid=105671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:02.615510 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: INFO nova.api.openstack.requestlog [None req-e0cf3204-4f63-4a1c-8eeb-730c1ca2ae6b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Sep 06 16:14:02.615936 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: [pid: 105671|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Sep 6 16:14:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:02.829618 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG nova.api.openstack.wsgi [None req-e66d0cd3-004f-486e-a50e-34786742008c admin admin] Calling method '>' {{(pid=105672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:02.834280 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-e66d0cd3-004f-486e-a50e-34786742008c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:02.834757 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-e66d0cd3-004f-486e-a50e-34786742008c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:02.835195 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-e66d0cd3-004f-486e-a50e-34786742008c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:02.836339 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-e66d0cd3-004f-486e-a50e-34786742008c admin admin] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:02.836835 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-e66d0cd3-004f-486e-a50e-34786742008c admin admin] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:02.837523 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: DEBUG oslo_concurrency.lockutils [None req-e66d0cd3-004f-486e-a50e-34786742008c admin admin] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:02.863586 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: INFO nova.api.openstack.requestlog [None req-e66d0cd3-004f-486e-a50e-34786742008c admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.101353 Sep 06 16:14:02.864179 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: [pid: 105672|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Sep 6 16:14:02 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:15:00.274329 dv-cinder-852210-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 06 16:15:00.275750 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: Tue Sep 6 16:15:00 2022 - graceful shutdown triggered... Sep 06 16:15:00.276431 dv-cinder-852210-10-iscsi devstack@n-api.service[105671]: Gracefully killing worker 1 (pid: 105671)... Sep 06 16:15:00.277043 dv-cinder-852210-10-iscsi devstack@n-api.service[105672]: Gracefully killing worker 2 (pid: 105672)... Sep 06 16:15:01.277066 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: worker 1 buried after 1 seconds Sep 06 16:15:01.277066 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: worker 2 buried after 1 seconds Sep 06 16:15:01.277066 dv-cinder-852210-10-iscsi devstack@n-api.service[105670]: goodbye to uWSGI. Sep 06 16:15:01.278865 dv-cinder-852210-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 06 16:15:01.279704 dv-cinder-852210-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 06 16:15:01.282750 dv-cinder-852210-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 16:15:01.296222 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 16:15:01 2022] *** Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: nodename: dv-cinder-852210-10-iscsi Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: machine: x86_64 Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: clock source: unix Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: pcre jit disabled Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: detected number of CPU cores: 4 Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: current working directory: / Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: detected binary path: /usr/bin/uwsgi-core Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: your processes number limit is 47680 Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: your memory page size is 4096 bytes Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: detected max file descriptor number: 2048 Sep 06 16:15:01.298879 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: lock engine: pthread robust mutexes Sep 06 16:15:01.299907 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: thunder lock: enabled Sep 06 16:15:01.299907 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 16:15:01.299907 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 16:15:01.338883 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: Python main interpreter initialized at 0x55b569f5f9c0 Sep 06 16:15:01.338883 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: python threads support enabled Sep 06 16:15:01.338883 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: your server socket listen backlog is limited to 100 connections Sep 06 16:15:01.338883 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: your mercy for graceful operations on workers is 90 seconds Sep 06 16:15:01.339376 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 16:15:01.339767 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: *** Operational MODE: preforking *** Sep 06 16:15:01.340355 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: *** uWSGI is running in multiple interpreter mode *** Sep 06 16:15:01.340496 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: spawned uWSGI master process (pid: 120650) Sep 06 16:15:01.340844 dv-cinder-852210-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 16:15:01.343904 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: spawned uWSGI worker 1 (pid: 120668, cores: 1) Sep 06 16:15:01.344451 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: spawned uWSGI worker 2 (pid: 120669, cores: 1) Sep 06 16:15:01.344912 dv-cinder-852210-10-iscsi devstack@n-api.service[120650]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 16:15:02.029470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 16:15:02.031143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 16:15:03.197792 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:15:03.197792 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: from cryptography.utils import int_from_bytes Sep 06 16:15:03.198511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:15:03.198511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: from cryptography.utils import int_from_bytes Sep 06 16:15:03.206988 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:15:03.206988 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: from cryptography.utils import int_from_bytes Sep 06 16:15:03.207495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:15:03.207495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: from cryptography.utils import int_from_bytes Sep 06 16:15:05.606245 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 16:15:05.606849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 16:15:05.607175 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 16:15:05.607384 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 16:15:05.607607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 16:15:05.608009 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.608334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.608655 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.609011 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.609341 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.609650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.609969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.610289 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.610616 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.610872 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.611184 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.611675 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-10-iscsi {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.611997 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.612308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.612623 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.612969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.613274 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.613610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.613959 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.614413 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.615955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.615955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.615955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.615955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.616279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.616490 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.616718 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.617059 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.617384 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.617687 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.618086 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-10-iscsi {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.618455 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.618768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.619070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.619489 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.619799 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.620109 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.620428 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.620738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.621071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.621398 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.621727 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.622028 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.622349 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.622702 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.622962 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.623257 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.623577 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.623913 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.624195 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.624476 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.624801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.625128 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.625441 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.625758 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.625985 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.626251 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.626540 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.626879 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.627185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.627448 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.627754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.628059 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.628360 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.628696 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.629005 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.629315 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.629596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.629914 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.630229 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.630536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.630876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 16:15:05.631531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.631758 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 16:15:05.631930 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.631930 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.632243 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 16:15:05.632432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.632583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 16:15:05.632735 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.632922 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 16:15:05.633159 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.633305 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.633459 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.633612 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.633766 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.634014 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.634177 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.634328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.634482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.634626 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.634775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.634927 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.635093 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.635249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.635401 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.635583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.635740 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.635908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.636051 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.636216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.636379 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.636537 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.636689 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.636689 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.637032 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-10-iscsi {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.637176 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.637317 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.637511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.637681 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.637861 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.638006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.638157 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.638305 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.638494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.638667 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.638841 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.639007 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.639160 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.639319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.639477 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.639477 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.639774 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.641116 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.641279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.641448 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.641610 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.641775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.641920 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.642072 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.642215 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.642364 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.642515 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.642679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.642833 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.642987 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.643136 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.643303 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.643447 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.643598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.643746 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.643895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.644046 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.644898 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.645061 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-10-iscsi {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.645225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.645387 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.645531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.645681 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.645824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.645967 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.646124 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.646124 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.646625 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.646902 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.647052 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.647210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.647367 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.647586 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.647739 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.647883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.648026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.648170 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.648341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.648495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.648637 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.648800 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.648963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.649126 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.649270 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.649415 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.649597 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.649751 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.649901 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.650090 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.651400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.651500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.651579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.651661 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.651752 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.651855 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.651943 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.652027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.652110 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.652209 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.652296 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.652389 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.652481 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.652569 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.652652 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.652736 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.652859 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.652957 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.653043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.653136 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.653222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.653222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.653396 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.653488 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.653575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.653668 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.653755 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.653847 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.653942 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.654034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.654118 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.654211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.654297 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.654393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.654478 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.654570 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.654659 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.654750 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.654833 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.654925 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.655016 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.655110 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.655195 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.655285 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.655378 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.655462 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.655554 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.655645 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.655729 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.655815 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.655917 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.656011 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.656095 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.656095 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.656247 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.656247 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.656421 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.656523 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.656616 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.656700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.656814 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.656902 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.656999 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.657092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.657183 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.657274 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.657359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.657455 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.657551 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.657737 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.657926 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.658101 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.658260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.658420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.658582 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.658735 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.658903 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.659059 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.659210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.659376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.659532 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.659682 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.659827 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.659988 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.660131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.660335 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.660487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.660644 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.660838 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.660997 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.661155 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.661305 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.661454 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.661605 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.661750 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.661898 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.662066 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.662242 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.662475 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.662727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.662877 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.663021 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.663267 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.663496 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.663645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.663795 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.663946 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.664091 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.664242 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.664396 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.664538 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.664687 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.664917 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.665161 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.665333 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.665487 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.665631 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.665772 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.665990 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.666165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.666321 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.666479 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.666652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.666801 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.666952 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.667125 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.667278 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.667422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.667592 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.667778 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.667949 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.668107 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.668252 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.668405 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.668561 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.668726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.668902 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.669054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.669206 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.669352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.669494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.669645 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.669795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.669948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.670099 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.670257 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.670418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.670572 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.670737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.670881 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.671023 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.671172 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.671322 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.671487 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.671632 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.671782 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.671924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.672066 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.672223 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.672376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.672636 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.672923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.673086 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.673250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.673492 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.673718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.673873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.674018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.674159 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.674301 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.674453 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.674655 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.674829 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.674995 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.675140 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.675282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.675441 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.675587 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.675729 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.675879 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.676030 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.676187 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.676330 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.676479 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:15:05.676631 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.676804 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.676977 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.677137 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.677281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.677433 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.677577 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.677982 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.678136 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.678295 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.678441 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.678592 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.678737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.678737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.679034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.679034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.679325 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.679468 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.679635 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.679635 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.679921 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.680066 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.680224 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.680367 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.680507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.680656 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.680872 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.681039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.681183 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.681333 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.681476 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.681630 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.681797 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.681950 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.682101 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.682252 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.682397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.682539 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.682806 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.682983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.683230 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.683387 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.683628 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.683870 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.684045 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.684206 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.684351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.684494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.684646 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.684851 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.684851 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.685187 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.685354 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.685505 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.685655 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.685809 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.685959 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.686111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.686254 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.686396 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.686537 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.686687 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.686837 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.686986 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.687130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.687289 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.687507 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.687653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.687802 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.688026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.688191 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.688336 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.688491 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.688642 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.688850 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.689010 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.689154 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.689306 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.689779 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.689927 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.690069 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.690221 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.690379 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.690526 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.690685 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.690840 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.690984 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.691126 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.691268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.691423 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.691574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.691735 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.691877 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.692026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.692186 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.692339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.692491 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.692645 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.692924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.693087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.693337 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.693781 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.694039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.694216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.694376 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.694521 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.694664 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.694826 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.694970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.695119 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.695270 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.695432 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.695585 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.695738 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.695889 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.696053 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.696218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.696422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.696577 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.696720 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.696900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.697046 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.697196 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.697347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.697503 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.697647 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.697789 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.697939 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.698146 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.698317 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.698472 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.698639 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.698798 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.698962 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.699115 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.699286 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.699452 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.699603 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.699761 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.699911 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.700060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.700218 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.700379 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.700529 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.700684 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.700891 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.701054 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.701213 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.701381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.701547 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.701714 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.701874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.702024 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.702201 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.702353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.702514 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.702663 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.702812 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.702978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.703278 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.703442 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.703592 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.703975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.703975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.704398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.704551 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.704699 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.704903 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.705229 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.705448 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.705615 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.705783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.705946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.706118 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.706278 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.706436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.706595 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.706768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.706927 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.707086 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.707264 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.707511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.707687 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.707847 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.707997 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.708192 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.708348 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.708528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.708691 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.708914 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.709095 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.709418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.710540 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.710701 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.710853 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.711004 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.711168 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.711328 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.711478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.711676 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.711830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.712020 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.712020 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.712483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.712812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.712986 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.713138 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.713138 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.713440 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.713801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.714312 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.714487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.714639 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.714789 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.714948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.715100 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.715256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.715409 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.715578 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.715744 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.715895 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.716052 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.716221 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.716379 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.716531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.716705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.716894 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.717046 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.717220 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.717386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.717560 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.717735 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.717885 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.718034 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.718245 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.718405 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.718565 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.718565 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.718869 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.719027 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.719185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.719342 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.719524 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.719696 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.719861 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.720022 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.720179 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.720356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.720530 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.720687 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.720941 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.721096 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.721255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.721422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.721571 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.721965 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.722171 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.722337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.722497 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.722672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.722849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.722849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.723623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.723822 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.724015 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.724233 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.724508 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.724678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.725040 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.725224 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.725392 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.725551 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.725722 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.725880 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.726040 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.726221 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.726372 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.726535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.726690 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.726850 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.727014 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.727175 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.727359 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.727566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.727724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.727887 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.728053 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.728212 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.728408 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.728570 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.728721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.728897 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.729064 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.729225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.729375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.729550 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.729701 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.729860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.730078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.730246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.730398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.730549 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.730698 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.730856 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.731014 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.731165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.731315 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.731481 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.731639 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.731817 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.731968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.732118 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.732274 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.732427 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.732584 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.732801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.732970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.733123 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.733273 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.733422 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.733583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.733742 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.733893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.734042 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.734198 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.734357 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.734542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.734730 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.734887 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.735044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.735194 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.735344 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.735502 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.735674 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.735834 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.735992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.736141 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.736305 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.736466 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.736617 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.736783 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.736941 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.737106 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.737273 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.737442 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.737638 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.737822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.738009 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.738161 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.738368 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.738569 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.738729 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.738882 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.739039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.739216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.739377 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.739537 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.739687 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.739848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.740007 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.740164 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.740398 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.740552 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.740705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.740922 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.741074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.741238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.741404 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.741563 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.741717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.741889 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.742212 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.742389 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.742552 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.742713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.742873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.743033 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.743227 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.743391 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.743552 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.743703 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.743877 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.744057 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.744218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.744397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.744568 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.744568 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.744918 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.744918 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.745236 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.745236 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.745565 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.745727 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.745887 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.746038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.746213 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.746366 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.746529 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.746688 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.746856 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.747006 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.747170 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.747351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.747503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.747654 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.747654 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.747952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.748186 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.748339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.748559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.748724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.748909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.749072 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.749236 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.749388 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.749549 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.749717 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.749877 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.750037 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.750196 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.750347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.750507 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.750676 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.750828 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.750986 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.751138 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.751287 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.751465 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.751627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.751786 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.751945 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.752111 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.752275 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.752436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.752600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.752782 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.752939 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.753090 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.753249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.753414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.753565 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.753915 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.754091 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.754254 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.754410 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.754538 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.754651 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.754780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.754902 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.755035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.755199 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.755384 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.755521 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.755660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.755789 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.755941 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.756067 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.756207 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.756351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.756472 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.756599 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.757126 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.757274 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.757466 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.757627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.757826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.758034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.758225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.758452 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.758696 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.758884 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.759030 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.759189 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.759347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.759497 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.759629 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.759759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.759888 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.760030 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.760030 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.760288 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.760288 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.760545 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.760674 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.760872 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.760872 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.761145 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.761283 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.761413 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.761543 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.761680 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.761819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.761949 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.762077 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.762209 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.762337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.762474 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.762618 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.762755 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.762886 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.763023 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.763161 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.763290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.763433 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.763564 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.763564 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.763818 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.763948 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.764099 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.764099 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.764362 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.764500 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.764629 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.764780 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.764930 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.765061 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.765197 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.765333 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.765463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.765599 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.765744 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.765884 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.765884 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.766182 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.766356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.766502 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.766642 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.766642 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.766922 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.767059 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.767208 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.767380 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.767528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.767688 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.767833 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.767984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.768135 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.768297 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.768442 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.768592 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.768889 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.769043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.769187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.769346 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.769506 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.769727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.769883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.770043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.770188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.770342 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.770508 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.770661 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.770813 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.770967 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.771125 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.771277 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.771429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.771573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.771573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.771853 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.772023 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.772182 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.772344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.772489 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.772639 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.772801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.772964 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.773117 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.773282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.773559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.773713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.773880 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.774043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.774195 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.774338 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.774540 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.774699 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.774854 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.774999 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.775175 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.775341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.775493 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.775644 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.775879 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.776038 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.776205 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.776351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.776351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.776655 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.776840 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.776993 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.777136 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.777280 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.777280 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.777584 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.777584 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.777865 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.778016 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.778159 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.778311 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.778464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.778646 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.778848 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.779015 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.779015 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.779309 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.779462 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.779613 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.779764 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.779922 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.780072 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.780224 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.780387 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.780541 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.780729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.780952 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.781111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.781256 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.781408 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.781554 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.781554 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.781846 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.782008 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.782165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.782309 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.782453 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.782614 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.782765 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.782916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.783069 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.783220 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.783363 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.783513 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.783657 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.783800 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.783969 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.784251 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.784405 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.784550 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.784704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.784911 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.785102 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.785274 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.785423 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.785575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.785728 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.785881 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.786026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.786168 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.786319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.786471 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.786625 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.786793 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.786938 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.787080 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.787229 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.787381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.787661 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.787817 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.787963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.788114 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.788259 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.788420 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.788574 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.788735 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.788954 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.789105 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.789258 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.789411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.789563 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.789705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.789857 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.790031 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.790265 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.790426 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.790586 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.790734 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.790893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.791045 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.791210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.791363 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.791508 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.791651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.791794 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.791946 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.792109 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.792264 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.792415 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.792559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.792702 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.792914 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.793075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.793240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.793240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.793522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.793675 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.793864 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.794026 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.794172 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.794315 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.794464 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.794609 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.794761 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.794922 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.795068 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.795226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.795377 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.795377 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.795666 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.795819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.795971 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.796123 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.796276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.796429 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.796586 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.796769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.796922 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.797075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.797221 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.797365 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.797591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.797591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.797882 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.798026 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.798168 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.798168 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.798451 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.798451 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.798748 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.798897 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.799091 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.799261 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.799415 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.799573 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.799726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.799876 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.800032 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.800197 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.800359 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.800359 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.800655 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.800867 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.801031 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.801196 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.801355 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.801516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.801684 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.801843 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.802012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.802192 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.802192 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.802500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.802651 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.802808 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.802984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.803145 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.803305 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.803464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.803615 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.803765 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.803923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.804082 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.804241 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.804393 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.804551 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.804702 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.804911 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.805022 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.805123 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.805213 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.805309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.805410 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.805507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.805596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.805727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.805844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.805946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.806071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.806194 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.806298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.806383 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.806457 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.806528 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.806642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.806727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.806808 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.806890 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.806970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.807056 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.807056 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.807203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.807278 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.807348 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.807419 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.807525 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.807606 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.807705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.807785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.807865 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.807865 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808016 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808090 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808161 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808311 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808395 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808467 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808552 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808628 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808922 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.808998 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809069 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809138 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809208 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809286 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809367 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809447 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809668 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809748 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809829 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.809991 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810066 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810137 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810346 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810425 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810498 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810576 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810656 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810728 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810805 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810877 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.810955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.811026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.811104 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.811177 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.811246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.811316 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.811456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.811585 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.811707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.811808 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.811903 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.811999 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.812093 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.812192 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.812284 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.812377 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.812470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.812543 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.812621 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.812706 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.812807 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.812905 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.813000 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.813086 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.813176 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.813270 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.813363 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.813455 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.813455 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.813587 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.813671 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.813799 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.813929 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.814018 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.814098 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.814184 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.814283 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.814357 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.814440 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.814860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.814951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.815039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.815124 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.815210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.815295 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.815374 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.815464 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.815543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.815636 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.815722 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.815722 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.815865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.815948 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.816035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.816109 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.816185 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.816264 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.816341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.816426 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.816507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.816579 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.816656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.816734 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.817029 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.817133 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.817288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.817377 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.817470 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.817563 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.817657 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.817743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.817743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.817908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.817990 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.818075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.818160 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.818269 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.818349 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.818429 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.818507 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.818580 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.818657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.818751 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.818846 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.818993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.819127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.819316 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.819552 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.819661 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.819861 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.819969 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.820174 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.820270 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.820547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.820654 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.820901 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.820998 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.821206 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.821429 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.821631 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.821777 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.821955 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.822052 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.822255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.822348 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.822571 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.822710 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.822882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.822983 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.823204 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.823297 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.823546 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.823748 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.823840 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.824156 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.824852 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.825187 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.825363 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.825590 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.825692 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.825947 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.826235 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.826366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.826575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.826701 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.826970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.827317 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.827422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.827667 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.827765 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.828091 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.828193 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.828381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.828486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.828664 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.828870 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.828962 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.829265 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.829584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.829817 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.829923 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.830169 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.830268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.830503 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.830613 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.830830 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.830925 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.831162 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.831305 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.831572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.831750 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.832024 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.832184 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.832288 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.832422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.832555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.832787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.833001 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.833197 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.833331 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.833531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.833632 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.833865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.834175 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.834282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.834370 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.834580 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.834687 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.834903 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.835032 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.835242 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.835477 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.835606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.836004 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.836180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.836430 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.836579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.836930 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.837313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.837476 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.837569 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.837673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.837765 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.838043 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.838178 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.838338 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.838504 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.838644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.838837 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.839077 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.839398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.839500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.839762 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.839933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.840085 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.840231 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.840424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.840564 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.840794 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.840912 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.841193 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.841514 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.841691 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.841844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.842014 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.842222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.842364 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.842531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.842681 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.842863 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.843110 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.843261 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.843366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.843572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.843668 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.843957 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.844051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.844287 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.844397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.844598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.844693 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.844938 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.845046 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.845248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.845368 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.845563 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.845713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.845885 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.846031 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.846198 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.846348 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.846506 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.846772 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.846894 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.847100 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.847228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.847408 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.847536 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.847715 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.847828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.848020 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.848123 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.848326 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.848437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.848637 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.848739 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.848968 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.849070 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.849272 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.849369 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.849577 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.849678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.849882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.849993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.850187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.850350 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.850491 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.850724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.850826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.851042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.851145 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.851384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.851477 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.851685 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.851777 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.851989 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.852097 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.852294 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.852400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.852715 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.852855 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.853075 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.853178 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.853392 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.853492 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.853713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.853815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.854023 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.854121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.854343 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.854443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.854657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.854960 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.855069 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.855292 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.855383 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.855607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.855707 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.855921 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.856015 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.856305 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.856405 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.856569 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.856717 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.856932 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.857129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.857282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.857385 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.857569 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.857690 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.857890 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.857985 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.858213 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.858315 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.858559 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.858718 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.858858 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.858952 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.859163 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.859263 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.859487 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.859595 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.859805 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.859921 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.860122 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.860224 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.860438 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.860554 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.860769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.860867 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.861093 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.861197 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.861404 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.861505 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.861715 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.861818 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.862026 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.862135 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.862408 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.862523 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.862649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.862743 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.862966 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.863070 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.863276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.863454 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.863588 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.863791 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.863891 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.864120 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.864216 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.864445 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.864543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.864796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.864895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.865104 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.865207 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.865423 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.865524 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.865749 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.865852 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.866092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.866261 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.866409 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.866551 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.866720 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.866870 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.867141 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.867305 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.867494 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.867635 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.867844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.868122 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.868511 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.868688 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.868892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.869050 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.869225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 16:15:05.869379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.869531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.869872 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.870171 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.870473 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.870837 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.871188 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.871527 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.871844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.872159 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.872663 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.872934 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.873142 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.873460 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.873772 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.874085 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.874404 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.874718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.875030 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.875341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.875652 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.875968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.876279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.876588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.876926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.877278 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.877605 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.877957 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.878300 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.878506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.878817 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.879126 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.879438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.879750 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.880093 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.880437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.880814 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.881151 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.881478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.881809 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.882130 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.882461 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.882793 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.883121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.883442 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.883882 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.884218 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.884541 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.884887 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.885210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.885532 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.885849 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.886188 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.886525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.886847 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.887183 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.887508 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.887837 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.888162 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.888481 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.888846 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.889170 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.889493 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.889811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.890134 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.890455 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.890784 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.891103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.891424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.891749 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.892073 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.892405 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.892762 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.893084 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.893420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.893756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.894115 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.894436 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.894792 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.895124 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.895445 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.895767 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.896078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:15:05.896326 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 16:15:05.931087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO dbcounter [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Registered counter for database nova_api Sep 06 16:15:05.953429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_db.sqlalchemy.engines [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:15:05.960600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO dbcounter [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Registered counter for database nova_api Sep 06 16:15:05.961043 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writer thread running {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:15:05.982806 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_db.sqlalchemy.engines [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:15:05.990127 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writer thread running {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:15:06.019537 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.context [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),862cff72-aa43-46ea-ad81-5a77b03254c2(cell1) {{(pid=120669) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 16:15:06.024737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:06.025256 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:06.026845 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:06.027658 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:06.028239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:06.030304 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:06.032338 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO dbcounter [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Registered counter for database nova_cell0 Sep 06 16:15:06.036481 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO dbcounter [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Registered counter for database nova_cell1 Sep 06 16:15:06.045253 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_db.sqlalchemy.engines [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:15:06.049294 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.context [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),862cff72-aa43-46ea-ad81-5a77b03254c2(cell1) {{(pid=120668) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 16:15:06.050158 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_db.sqlalchemy.engines [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:15:06.054632 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:06.055140 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:06.056707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writer thread running {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:15:06.057563 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:06.058432 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:06.059189 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:06.061556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:06.063892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO dbcounter [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Registered counter for database nova_cell0 Sep 06 16:15:06.069614 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO dbcounter [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Registered counter for database nova_cell1 Sep 06 16:15:06.078504 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_db.sqlalchemy.engines [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:15:06.085888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_db.sqlalchemy.engines [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:15:06.090962 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writer thread running {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:15:06.202898 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writer thread running {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:15:06.211709 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO dbcounter [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Registered counter for database nova_cell0 Sep 06 16:15:06.218579 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_db.sqlalchemy.engines [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:15:06.223268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writer thread running {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:15:06.238559 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writer thread running {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:15:06.248392 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO dbcounter [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Registered counter for database nova_cell0 Sep 06 16:15:06.255220 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_db.sqlalchemy.engines [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:15:06.260420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writer thread running {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:15:06.539590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: WARNING keystonemiddleware.auth_token [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:15:06.547004 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: WARNING keystonemiddleware.auth_token [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:15:06.582088 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: WARNING keystonemiddleware.auth_token [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:15:06.589535 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: WARNING keystonemiddleware.auth_token [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:15:06.896915 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: WARNING keystonemiddleware.auth_token [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:15:06.903076 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: WARNING keystonemiddleware.auth_token [None req-0d3c4af0-c714-4f92-be47-d600ee34e210 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:15:06.908736 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b569f5f9c0 pid: 120669 (default app) Sep 06 16:15:06.936848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: WARNING keystonemiddleware.auth_token [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:15:06.943257 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: WARNING keystonemiddleware.auth_token [None req-926eb92a-ffe9-4dc0-9760-e416728ad128 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:15:06.948899 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b569f5f9c0 pid: 120668 (default app) Sep 06 16:15:44.411791 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=3 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:44.415812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=3 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:44.416984 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=3 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:44.419638 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=3 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:45.679267 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7da11bed-5612-447d-90d0-9bc01bea5993 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Action: 'create', calling method: .version_select at 0x7f83ea497310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1970328858", "metadata": {"Type": "work"}}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:48.179533 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7da11bed-5612-447d-90d0-9bc01bea5993 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.777633 Sep 06 16:15:48.193632 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Sep 6 16:15:44 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3780 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 06 16:15:48.872264 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1dfb9427-524b-444a-ae7d-c067e714173b tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Calling method '.version_select at 0x7f83ea5403a0>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:48.956994 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=3 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:48.958616 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=3 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:48.963597 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=3 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:48.966058 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=3 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:49.774894 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1dfb9427-524b-444a-ae7d-c067e714173b tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c" status: 200 len: 353 microversion: 2.1 time: 1.574928 Sep 06 16:15:49.786893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 1/2] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:15:48 2022] GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c => generated 353 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:50.791884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9e3b259f-1134-486b-bb1d-efe53b23e72d tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Calling method '.version_select at 0x7f83ea3781f0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:51.173924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9e3b259f-1134-486b-bb1d-efe53b23e72d tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c" status: 200 len: 354 microversion: 2.1 time: 0.386251 Sep 06 16:15:51.175194 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:15:50 2022] GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c => generated 354 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:15:51.198801 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5bee0959-14c6-46d6-898f-4993a9436858 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Calling method '.version_select at 0x7f83ea35e160>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:51.380333 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5bee0959-14c6-46d6-898f-4993a9436858 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c" status: 200 len: 354 microversion: 2.1 time: 0.188640 Sep 06 16:15:51.381414 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:15:51 2022] GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c => generated 354 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:51.405558 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c3bfabc1-4ec8-4aa2-9a83-a2db29ba93ad tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Calling method '.version_select at 0x7f83ea3788b0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:51.590438 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c3bfabc1-4ec8-4aa2-9a83-a2db29ba93ad tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c" status: 202 len: 0 microversion: 2.1 time: 0.191619 Sep 06 16:15:51.591360 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 3/5] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 6 16:15:51 2022] DELETE /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:15:51.602681 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ece4fc5b-8de8-43bd-947c-928f15e2d410 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Calling method '.version_select at 0x7f83ea35e280>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:51.673793 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ece4fc5b-8de8-43bd-947c-928f15e2d410 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c" status: 200 len: 353 microversion: 2.1 time: 0.076794 Sep 06 16:15:51.674880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 3/6] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:15:51 2022] GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:52.696093 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-bb670f4c-860e-4ecb-9a93-9f086012c4d6 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Calling method '.version_select at 0x7f83ea378f70>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:52.840413 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-bb670f4c-860e-4ecb-9a93-9f086012c4d6 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c" status: 200 len: 353 microversion: 2.1 time: 0.149452 Sep 06 16:15:52.841665 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:15:52 2022] GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c => generated 353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:53.856951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-99a47ee3-6cd7-4df5-abe1-ade2d74822a3 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Calling method '.version_select at 0x7f83ea35e8b0>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:54.040866 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-99a47ee3-6cd7-4df5-abe1-ade2d74822a3 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c" status: 200 len: 353 microversion: 2.1 time: 0.189545 Sep 06 16:15:54.049402 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:15:53 2022] GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c => generated 353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:55.055986 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-78dae297-91c7-4591-a427-3b54e7344d4e tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Calling method '.version_select at 0x7f83ea378d30>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:55.166715 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-78dae297-91c7-4591-a427-3b54e7344d4e tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c" status: 200 len: 353 microversion: 2.1 time: 0.114531 Sep 06 16:15:55.169681 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 5/9] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:15:55 2022] GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:55.360108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c75fdbce-50b4-45f3-916d-06ea3a3fd64a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Action: 'create', calling method: .version_select at 0x7f83ea35eee0>, body: {"keypair": {"name": "tempest-keypair-203030134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4iQm2TiTcPek40lC5HYKNXpJW5lhDn4Hhmt2BQtallLuJl/tn1yk6R5gg7kAreoo0H2g7KA5JT/QKsv9whYfvQsWNGtKTwFfEuugWUKqRfVstbiByhdHiqQhTwFZL5jA=="}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:55.420991 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-c75fdbce-50b4-45f3-916d-06ea3a3fd64a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Getting quotas for project ad0bef00a05c4029a009992a7f96fa80. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:15:55.431816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-c75fdbce-50b4-45f3-916d-06ea3a3fd64a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Getting quotas for user e225aec64aee47449542aecbec0ae561 and project ad0bef00a05c4029a009992a7f96fa80. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:15:55.520730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c75fdbce-50b4-45f3-916d-06ea3a3fd64a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.242032 Sep 06 16:15:55.523061 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 5/10] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 6 16:15:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:56.181687 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fb42a750-d607-47d9-9f9e-f8b2fda4cbf6 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Calling method '.version_select at 0x7f83ea3785e0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:56.362033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fb42a750-d607-47d9-9f9e-f8b2fda4cbf6 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c" status: 200 len: 353 microversion: 2.1 time: 0.184596 Sep 06 16:15:56.362738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 6/11] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:15:56 2022] GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c => generated 353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:57.342492 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-992d2b47-698e-4805-abe5-df10e9854367 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Action: 'create', calling method: .version_select at 0x7f83ea2c8ee0>, body: {"keypair": {"name": "tempest-keypair-1721304744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjPCVM602yoKYb8cIEBBGTTzdxD9lXXXvgi4M3KwqAGRJAObz8ROyfnb3bf2fHZhpQgCTgSF7xtUc8vfYSgedNc5rULoJ8KjRnwKq2N5VSm2z0ilc8HBGQ2eo4vjaftfQ=="}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:57.372331 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-992d2b47-698e-4805-abe5-df10e9854367 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Getting quotas for project 8b93a6978c404ca4aa497919103b5283. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:15:57.381933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f1ceb11a-dfa8-4975-b43d-335c0950f80f tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Calling method '.version_select at 0x7f83ea378040>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:57.383713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-992d2b47-698e-4805-abe5-df10e9854367 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Getting quotas for user c3a65f26ab214feab60c7b6380539076 and project 8b93a6978c404ca4aa497919103b5283. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:15:57.460787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-992d2b47-698e-4805-abe5-df10e9854367 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.221465 Sep 06 16:15:57.461499 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 6/12] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Sep 6 16:15:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 223 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 16:15:57.514499 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f1ceb11a-dfa8-4975-b43d-335c0950f80f tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c" status: 200 len: 353 microversion: 2.1 time: 0.141858 Sep 06 16:15:57.515451 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:15:57 2022] GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:58.528320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c26f5d70-09ba-4665-8554-9ee479870727 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Calling method '.version_select at 0x7f83ea288310>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:58.599022 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c26f5d70-09ba-4665-8554-9ee479870727 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c" status: 200 len: 353 microversion: 2.1 time: 0.074390 Sep 06 16:15:58.599999 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 7/14] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:15:58 2022] GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:59.621177 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-85746fe3-1318-42b5-9a16-5d57cfd4bb44 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Calling method '.version_select at 0x7f83ea303670>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:59.679063 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-85746fe3-1318-42b5-9a16-5d57cfd4bb44 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] HTTP exception thrown: Volume ebfd1e3e-46ce-4392-bba1-dc230819759c could not be found. Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-85746fe3-1318-42b5-9a16-5d57cfd4bb44 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Request method failure captured: Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c HTTP/1.1 Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3IwgmjkvOQW1ILK59llQRq6G2UpFWWeSGxdLtFW69r-wtW44IG2ksOEUtLPFBoHQTvftkyvV9Eo4Zrw893ApBPE19CK6QCrs_Mmiqee581k_S5eIFGYDQ7K0WKLLsZBUPdsOMH_rFGGtE4Y9emBxCjulLr4L4yyOMXnfbGBuOCSFHs Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 19286596a2414ae78ba7080b971364ca Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesGetTestJSON-1080428861 Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:15:59.685575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/19286596a2414ae78ba7080b971364ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/19286596a2414ae78ba7080b971364ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_19286596a2414ae78ba7080b971364ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/19286596a2414ae78ba7080b971364ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesGetTestJSON-1080428861 Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 19286596a2414ae78ba7080b971364ca Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesGetTestJSON-1080428861 Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesGetTestJSON-1080428861-project Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: f180909caf24492db646b89ebd8ca214 Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesGetTestJSON-1080428861-project Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Volume ebfd1e3e-46ce-4392-bba1-dc230819759c could not be found. Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'ebfd1e3e-46ce-4392-bba1-dc230819759c'} Sep 06 16:15:59.686794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ebfd1e3e-46ce-4392-bba1-dc230819759c could not be found. (HTTP 404) (Request-ID: req-6007e79d-6f21-4833-9156-61e321d67450) Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:15:59.687486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:15:59.690642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ebfd1e3e-46ce-4392-bba1-dc230819759c could not be found. Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 16:15:59.691775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:15:59.694657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ebfd1e3e-46ce-4392-bba1-dc230819759c could not be found. Sep 06 16:15:59.694657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:15:59.694657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:15:59.694657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:15:59.694657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:15:59.694657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:15:59.694657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:15:59.694657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:15:59.694657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:15:59.694657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ebfd1e3e-46ce-4392-bba1-dc230819759c could not be found. Sep 06 16:15:59.694657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:15:59.698063 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-85746fe3-1318-42b5-9a16-5d57cfd4bb44 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] Returning 404 to user: Volume ebfd1e3e-46ce-4392-bba1-dc230819759c could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:15:59.699411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-85746fe3-1318-42b5-9a16-5d57cfd4bb44 tempest-VolumesGetTestJSON-1080428861 tempest-VolumesGetTestJSON-1080428861-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c" status: 404 len: 109 microversion: 2.1 time: 0.089509 Sep 06 16:15:59.711059 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 8/15] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:15:59 2022] GET /compute/v2.1/os-volumes/ebfd1e3e-46ce-4392-bba1-dc230819759c => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:16:02.480484 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1868801591", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a85fb19-0212-415f-99a3-26579fc91ae5"}], "security_groups": [{"name": "tempest-securitygroup--1614765274"}], "key_name": "tempest-keypair-203030134", "user_data": "}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:02.862035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] validate_networks() for [('3a85fb19-0212-415f-99a3-26579fc91ae5', None, None, None, None, None)] {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:16:03.055268 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1055676723", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "networks": [{"uuid": "85824e5c-6098-408c-9d81-a8ca4e103601"}]}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:03.318124 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.network.neutron [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] validate_networks() for [('85824e5c-6098-408c-9d81-a8ca4e103601', None, None, None, None, None)] {{(pid=120668) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:16:04.642659 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:16:04.644151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:16:04.645760 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:16:04.646460 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:16:04.647054 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:16:04.682412 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:04.683200 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:04.683751 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:04.684527 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:04.685011 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:04.685432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:04.768554 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Getting quotas for project ad0bef00a05c4029a009992a7f96fa80. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:16:04.791079 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Getting quotas for user e225aec64aee47449542aecbec0ae561 and project ad0bef00a05c4029a009992a7f96fa80. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:16:04.835070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:16:04.840136 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:16:05.006351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e644a481-f12e-43d3-956b-44081a1e3e10 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.528518 Sep 06 16:16:05.007914 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 9/16] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:16:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:16:05.606868 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Flavor limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:16:05.607618 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Image limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:16:05.609025 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Flavor pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:16:05.610157 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Image pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:16:05.611424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:16:05.641201 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1537978743", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:05.651350 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:05.654590 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:05.656585 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:05.660728 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:05.663292 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:05.664371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:05.779294 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Getting quotas for project c66250df2e054415b517b2de8857bc87. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:16:05.785531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Getting quotas for user 8978e7cc78ab4c559dfd3e22cde34569 and project c66250df2e054415b517b2de8857bc87. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:16:05.804919 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Going to run 1 instances... {{(pid=120668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:16:05.808670 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:16:05.826721 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] validate_networks() for [('2f9940ad-7a47-4053-bec0-907c40de1d34', None, None, None, None, None)] {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:16:05.911485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-593616e0-4b73-4847-ad79-e86b5f7589f6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.561755 Sep 06 16:16:05.913085 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 8/17] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:16:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:16:05.922476 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-67763836-f0fd-4434-a6af-d32fc69084a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:05.923424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-67763836-f0fd-4434-a6af-d32fc69084a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:06.262172 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-67763836-f0fd-4434-a6af-d32fc69084a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:06.307339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-67763836-f0fd-4434-a6af-d32fc69084a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1237 microversion: 2.1 time: 0.392692 Sep 06 16:16:06.333039 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 9/18] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:05 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1237 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:06.363119 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-461358830", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e00a66dc-f0ca-4fcd-9aa2-b28b6fad62d0"}], "security_groups": [{"name": "tempest-securitygroup--1769905221"}], "key_name": "tempest-keypair-1721304744", "user_data": "}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:06.675710 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.network.neutron [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] validate_networks() for [('e00a66dc-f0ca-4fcd-9aa2-b28b6fad62d0', None, None, None, None, None)] {{(pid=120668) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:16:07.126601 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:16:07.128059 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:16:07.128682 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:16:07.129503 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:16:07.129929 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:16:07.150987 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:07.157671 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:07.158137 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.158955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:07.159420 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:07.159858 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.216975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Getting quotas for project 49a3e0cfba224a119bf8aaf26ae583f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:16:07.254591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Getting quotas for user 93096a58fcb34f2085a05ffa40df5937 and project 49a3e0cfba224a119bf8aaf26ae583f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:16:07.307098 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:16:07.309552 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:16:07.504091 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f56e7a2f-1d42-48a6-9c5d-300756c2f0a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.494427 Sep 06 16:16:07.504652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 10/19] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:16:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:16:07.525350 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Flavor limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:16:07.525750 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Image limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:16:07.526236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Flavor pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:16:07.526772 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Image pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:16:07.527257 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:16:07.543880 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f7052e39-4264-446c-8de9-0e758304f394 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:07.546010 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f7052e39-4264-446c-8de9-0e758304f394 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:07.571653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:07.573888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:07.574790 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.577717 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:07.578953 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:07.581047 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.665482 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Getting quotas for project 8b93a6978c404ca4aa497919103b5283. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:16:07.673620 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Getting quotas for user c3a65f26ab214feab60c7b6380539076 and project 8b93a6978c404ca4aa497919103b5283. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:16:07.712092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Going to run 1 instances... {{(pid=120668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:16:07.718598 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:16:07.803458 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f7052e39-4264-446c-8de9-0e758304f394 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:07.831063 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f7052e39-4264-446c-8de9-0e758304f394 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1215 microversion: 2.1 time: 0.325278 Sep 06 16:16:07.836092 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 11/20] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:07 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1215 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:07.843407 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b7524a26-329e-4578-a4c9-eaf3f05fffb9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:07.844327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b7524a26-329e-4578-a4c9-eaf3f05fffb9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:07.852430 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b7524a26-329e-4578-a4c9-eaf3f05fffb9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:07.853372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b7524a26-329e-4578-a4c9-eaf3f05fffb9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:07.854053 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b7524a26-329e-4578-a4c9-eaf3f05fffb9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.854967 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b7524a26-329e-4578-a4c9-eaf3f05fffb9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:07.856306 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b7524a26-329e-4578-a4c9-eaf3f05fffb9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:07.857039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b7524a26-329e-4578-a4c9-eaf3f05fffb9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.868672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5dc07e86-0514-48cc-9ff5-52af3f8ddc14 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.531660 Sep 06 16:16:07.875139 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 10/21] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Sep 6 16:16:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 16:16:07.889907 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7a25f215-77c6-4308-9392-df332e1becaf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:07.901139 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7a25f215-77c6-4308-9392-df332e1becaf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:08.054778 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7a25f215-77c6-4308-9392-df332e1becaf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:08.065727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7a25f215-77c6-4308-9392-df332e1becaf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1222 microversion: 2.1 time: 0.183416 Sep 06 16:16:08.080790 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 11/22] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:07 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1222 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:08.080790 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ae233a6d-aedd-4360-821a-c7cb4e7dd315 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:08.084651 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ae233a6d-aedd-4360-821a-c7cb4e7dd315 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:08.140782 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b7524a26-329e-4578-a4c9-eaf3f05fffb9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:08.143763 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b7524a26-329e-4578-a4c9-eaf3f05fffb9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1241 microversion: 2.1 time: 0.306343 Sep 06 16:16:08.144368 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 12/23] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:07 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1241 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:08.223889 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1974118938", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:08.307525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ae233a6d-aedd-4360-821a-c7cb4e7dd315 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:08.343839 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ae233a6d-aedd-4360-821a-c7cb4e7dd315 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:08.346924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ae233a6d-aedd-4360-821a-c7cb4e7dd315 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:08.357507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ae233a6d-aedd-4360-821a-c7cb4e7dd315 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1281 microversion: 2.20 time: 0.286276 Sep 06 16:16:08.359351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 12/24] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:08 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1281 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:08.380087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] validate_networks() for [('2f9940ad-7a47-4053-bec0-907c40de1d34', None, None, None, None, None)] {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:16:08.867860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1d58027d-fe53-47a5-8932-c152d1ca7099 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:08.868901 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1d58027d-fe53-47a5-8932-c152d1ca7099 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:08.886324 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d58027d-fe53-47a5-8932-c152d1ca7099 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:08.886996 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d58027d-fe53-47a5-8932-c152d1ca7099 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:08.887543 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d58027d-fe53-47a5-8932-c152d1ca7099 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:08.893117 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d58027d-fe53-47a5-8932-c152d1ca7099 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:08.893637 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d58027d-fe53-47a5-8932-c152d1ca7099 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:08.894088 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d58027d-fe53-47a5-8932-c152d1ca7099 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:09.203039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:16:09.203474 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:16:09.203927 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:16:09.204339 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:16:09.204782 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:16:09.216355 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:09.216889 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:09.218826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:09.221884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:09.223989 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:09.225019 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:09.249999 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1d58027d-fe53-47a5-8932-c152d1ca7099 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:09.262353 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1d58027d-fe53-47a5-8932-c152d1ca7099 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1211 microversion: 2.1 time: 0.410367 Sep 06 16:16:09.263502 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 13/25] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:08 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1211 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:09.268477 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-36043159-849e-4d54-b7fa-d638eefc5fa0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:09.269286 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-36043159-849e-4d54-b7fa-d638eefc5fa0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:09.278571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-36043159-849e-4d54-b7fa-d638eefc5fa0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:09.279464 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-36043159-849e-4d54-b7fa-d638eefc5fa0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:09.280106 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-36043159-849e-4d54-b7fa-d638eefc5fa0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:09.281199 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-36043159-849e-4d54-b7fa-d638eefc5fa0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:09.281848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-36043159-849e-4d54-b7fa-d638eefc5fa0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:09.282499 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-36043159-849e-4d54-b7fa-d638eefc5fa0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:09.291344 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Getting quotas for project 49a3e0cfba224a119bf8aaf26ae583f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:16:09.306100 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Getting quotas for user 93096a58fcb34f2085a05ffa40df5937 and project 49a3e0cfba224a119bf8aaf26ae583f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:16:09.331070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:16:09.338242 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:16:09.427631 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4d6344fa-f334-418e-aaa5-a26e9746e666 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.208561 Sep 06 16:16:09.428551 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 13/26] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:16:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:16:09.439099 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-36043159-849e-4d54-b7fa-d638eefc5fa0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:09.445346 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e325aa27-b3a4-4136-8cc1-42b7460a8506 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:09.446947 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e325aa27-b3a4-4136-8cc1-42b7460a8506 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:09.481190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-36043159-849e-4d54-b7fa-d638eefc5fa0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1289 microversion: 2.1 time: 0.211189 Sep 06 16:16:09.481424 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e325aa27-b3a4-4136-8cc1-42b7460a8506 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:09.481734 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e325aa27-b3a4-4136-8cc1-42b7460a8506 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:09.482576 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e325aa27-b3a4-4136-8cc1-42b7460a8506 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:09.483585 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e325aa27-b3a4-4136-8cc1-42b7460a8506 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:09.483958 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 14/27] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:09 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1289 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:09.484728 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e325aa27-b3a4-4136-8cc1-42b7460a8506 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:09.485330 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e325aa27-b3a4-4136-8cc1-42b7460a8506 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:09.502030 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-bd598443-9c95-4f1a-adfe-04ef8a4a0767 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:09.504771 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-bd598443-9c95-4f1a-adfe-04ef8a4a0767 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:09.592824 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-bd598443-9c95-4f1a-adfe-04ef8a4a0767 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:09.604879 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-bd598443-9c95-4f1a-adfe-04ef8a4a0767 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1222 microversion: 2.1 time: 0.119486 Sep 06 16:16:09.620698 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e325aa27-b3a4-4136-8cc1-42b7460a8506 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:09.625971 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 15/28] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:09 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1222 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:09.630982 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e325aa27-b3a4-4136-8cc1-42b7460a8506 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:09.632609 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e325aa27-b3a4-4136-8cc1-42b7460a8506 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:09.633995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e325aa27-b3a4-4136-8cc1-42b7460a8506 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1277 microversion: 2.20 time: 0.198240 Sep 06 16:16:09.635243 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 14/29] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:09 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:10.296388 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-603ca262-e317-49b6-9dc5-884cefedc976 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:10.298270 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-603ca262-e317-49b6-9dc5-884cefedc976 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:10.313711 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-603ca262-e317-49b6-9dc5-884cefedc976 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.315883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-603ca262-e317-49b6-9dc5-884cefedc976 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.320616 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-603ca262-e317-49b6-9dc5-884cefedc976 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.321605 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-603ca262-e317-49b6-9dc5-884cefedc976 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.330079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-603ca262-e317-49b6-9dc5-884cefedc976 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.330917 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-603ca262-e317-49b6-9dc5-884cefedc976 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.359119 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f3db0e6d-df55-45d5-ace3-29c1aba2ffc1 tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] Calling method '.version_select at 0x7f83e991af70>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:10.471984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-603ca262-e317-49b6-9dc5-884cefedc976 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:10.482800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-603ca262-e317-49b6-9dc5-884cefedc976 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1275 microversion: 2.1 time: 0.198433 Sep 06 16:16:10.493800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 16/30] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:10 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:10.513135 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-26ef7107-1840-438f-99ea-c5f4777a1eb8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:10.514087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-26ef7107-1840-438f-99ea-c5f4777a1eb8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:10.514990 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f3db0e6d-df55-45d5-ace3-29c1aba2ffc1 tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/d7eace44-e53d-4b44-b24c-81a3e6e16301" status: 200 len: 351 microversion: 2.1 time: 0.160384 Sep 06 16:16:10.515883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 15/31] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:16:10 2022] GET /compute/v2.1/os-volumes/d7eace44-e53d-4b44-b24c-81a3e6e16301 => generated 351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:16:10.533768 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-26ef7107-1840-438f-99ea-c5f4777a1eb8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.535324 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-26ef7107-1840-438f-99ea-c5f4777a1eb8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.536341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-26ef7107-1840-438f-99ea-c5f4777a1eb8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.537164 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-26ef7107-1840-438f-99ea-c5f4777a1eb8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.537672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-26ef7107-1840-438f-99ea-c5f4777a1eb8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.538098 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-26ef7107-1840-438f-99ea-c5f4777a1eb8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.633216 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c0d0be8d-19bf-46d5-bb39-54a40b66ea89 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:10.633965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c0d0be8d-19bf-46d5-bb39-54a40b66ea89 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:10.644410 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c0d0be8d-19bf-46d5-bb39-54a40b66ea89 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.646609 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c0d0be8d-19bf-46d5-bb39-54a40b66ea89 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.652463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c0d0be8d-19bf-46d5-bb39-54a40b66ea89 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.660440 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c0d0be8d-19bf-46d5-bb39-54a40b66ea89 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.662096 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c0d0be8d-19bf-46d5-bb39-54a40b66ea89 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.662801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c0d0be8d-19bf-46d5-bb39-54a40b66ea89 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.694496 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-26ef7107-1840-438f-99ea-c5f4777a1eb8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:10.706951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-26ef7107-1840-438f-99ea-c5f4777a1eb8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1307 microversion: 2.1 time: 0.198353 Sep 06 16:16:10.715687 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 17/32] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:10 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1307 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:10.732384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e176e3ef-0f45-4cb2-9485-fcc8dcfdff80 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:10.733023 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e176e3ef-0f45-4cb2-9485-fcc8dcfdff80 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:10.761435 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e176e3ef-0f45-4cb2-9485-fcc8dcfdff80 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.761929 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e176e3ef-0f45-4cb2-9485-fcc8dcfdff80 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.762361 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e176e3ef-0f45-4cb2-9485-fcc8dcfdff80 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.763068 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e176e3ef-0f45-4cb2-9485-fcc8dcfdff80 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.763581 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e176e3ef-0f45-4cb2-9485-fcc8dcfdff80 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.764005 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e176e3ef-0f45-4cb2-9485-fcc8dcfdff80 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.864832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c0d0be8d-19bf-46d5-bb39-54a40b66ea89 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:10.885298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c0d0be8d-19bf-46d5-bb39-54a40b66ea89 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1226 microversion: 2.1 time: 0.256357 Sep 06 16:16:10.886740 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 16/33] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:10 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1226 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:10.980329 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e176e3ef-0f45-4cb2-9485-fcc8dcfdff80 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:11.016577 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e176e3ef-0f45-4cb2-9485-fcc8dcfdff80 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:11.020432 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e176e3ef-0f45-4cb2-9485-fcc8dcfdff80 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:11.023791 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e176e3ef-0f45-4cb2-9485-fcc8dcfdff80 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1333 microversion: 2.20 time: 0.306890 Sep 06 16:16:11.037820 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 18/34] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:10 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1333 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:11.508955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-55b32c67-d6f4-42ff-b1c6-316c15c81466 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:11.509773 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-55b32c67-d6f4-42ff-b1c6-316c15c81466 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:11.529972 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-55b32c67-d6f4-42ff-b1c6-316c15c81466 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:11.530595 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-55b32c67-d6f4-42ff-b1c6-316c15c81466 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:11.546025 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-55b32c67-d6f4-42ff-b1c6-316c15c81466 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:11.548712 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-55b32c67-d6f4-42ff-b1c6-316c15c81466 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:11.553733 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-55b32c67-d6f4-42ff-b1c6-316c15c81466 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:11.554247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-55b32c67-d6f4-42ff-b1c6-316c15c81466 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:11.737631 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-abd96ace-942c-4b59-8ae1-bf7f889df04a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:11.738900 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-abd96ace-942c-4b59-8ae1-bf7f889df04a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:11.750315 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-abd96ace-942c-4b59-8ae1-bf7f889df04a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:11.751108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-abd96ace-942c-4b59-8ae1-bf7f889df04a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:11.751723 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-abd96ace-942c-4b59-8ae1-bf7f889df04a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:11.752739 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-abd96ace-942c-4b59-8ae1-bf7f889df04a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:11.755253 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-abd96ace-942c-4b59-8ae1-bf7f889df04a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:11.755899 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-abd96ace-942c-4b59-8ae1-bf7f889df04a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:11.915910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-55b32c67-d6f4-42ff-b1c6-316c15c81466 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:11.925073 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-55b32c67-d6f4-42ff-b1c6-316c15c81466 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1273 microversion: 2.1 time: 0.421910 Sep 06 16:16:11.927288 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 17/35] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:11 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1273 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:11.948722 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7a487811-eabe-4195-9956-e200aecef21d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:11.949553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7a487811-eabe-4195-9956-e200aecef21d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:11.982030 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7a487811-eabe-4195-9956-e200aecef21d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:11.983515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7a487811-eabe-4195-9956-e200aecef21d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:11.985160 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7a487811-eabe-4195-9956-e200aecef21d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:11.990192 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7a487811-eabe-4195-9956-e200aecef21d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:11.991814 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7a487811-eabe-4195-9956-e200aecef21d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:11.994579 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7a487811-eabe-4195-9956-e200aecef21d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:12.079635 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-abd96ace-942c-4b59-8ae1-bf7f889df04a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:12.095736 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-abd96ace-942c-4b59-8ae1-bf7f889df04a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1295 microversion: 2.1 time: 0.356819 Sep 06 16:16:12.110613 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 19/36] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:11 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1295 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:12.128851 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7124c15b-c7ee-4f92-a411-76c808b79341 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:12.130914 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7124c15b-c7ee-4f92-a411-76c808b79341 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:12.151845 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7124c15b-c7ee-4f92-a411-76c808b79341 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:12.154231 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7124c15b-c7ee-4f92-a411-76c808b79341 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:12.155013 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7124c15b-c7ee-4f92-a411-76c808b79341 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:12.156408 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7124c15b-c7ee-4f92-a411-76c808b79341 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:12.160547 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7124c15b-c7ee-4f92-a411-76c808b79341 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:12.161295 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7124c15b-c7ee-4f92-a411-76c808b79341 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:12.205119 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7a487811-eabe-4195-9956-e200aecef21d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:12.217672 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7a487811-eabe-4195-9956-e200aecef21d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1274 microversion: 2.1 time: 0.288111 Sep 06 16:16:12.218624 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 18/37] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:11 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1274 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:12.315923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7124c15b-c7ee-4f92-a411-76c808b79341 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:12.329939 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7124c15b-c7ee-4f92-a411-76c808b79341 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:12.335010 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7124c15b-c7ee-4f92-a411-76c808b79341 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:12.336480 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7124c15b-c7ee-4f92-a411-76c808b79341 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.224506 Sep 06 16:16:12.339506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 20/38] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:12 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:12.394154 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8dbb43f0-53c5-46dc-9e69-c95adf7911ec tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] Calling method '.version_select at 0x7f83e991adc0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:12.522330 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8dbb43f0-53c5-46dc-9e69-c95adf7911ec tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/b523e7ac-ed0f-4c32-bd4b-db3e3a48c888" status: 200 len: 351 microversion: 2.1 time: 0.139523 Sep 06 16:16:12.525007 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 19/39] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:16:12 2022] GET /compute/v2.1/os-volumes/b523e7ac-ed0f-4c32-bd4b-db3e3a48c888 => generated 351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:16:12.953076 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-27424ed3-b953-4465-943f-8050af820e74 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:12.954074 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-27424ed3-b953-4465-943f-8050af820e74 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:12.965625 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-27424ed3-b953-4465-943f-8050af820e74 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:12.967766 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-27424ed3-b953-4465-943f-8050af820e74 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:12.968628 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-27424ed3-b953-4465-943f-8050af820e74 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:12.970435 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-27424ed3-b953-4465-943f-8050af820e74 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:12.971657 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-27424ed3-b953-4465-943f-8050af820e74 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:12.974282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-27424ed3-b953-4465-943f-8050af820e74 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:13.125418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-22142d99-8aa4-4053-abe5-41f1eb50b144 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:13.126025 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-22142d99-8aa4-4053-abe5-41f1eb50b144 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:13.140849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-22142d99-8aa4-4053-abe5-41f1eb50b144 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:13.141681 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-22142d99-8aa4-4053-abe5-41f1eb50b144 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:13.142373 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-22142d99-8aa4-4053-abe5-41f1eb50b144 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:13.143435 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-22142d99-8aa4-4053-abe5-41f1eb50b144 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:13.144111 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-22142d99-8aa4-4053-abe5-41f1eb50b144 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:13.144726 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-22142d99-8aa4-4053-abe5-41f1eb50b144 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:13.379475 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-22142d99-8aa4-4053-abe5-41f1eb50b144 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:13.389639 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-22142d99-8aa4-4053-abe5-41f1eb50b144 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1295 microversion: 2.1 time: 0.269409 Sep 06 16:16:13.401768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 20/40] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:13 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1295 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:13.414262 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-da81672d-9465-4df9-b272-c63b14c1dc88 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:13.415189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-da81672d-9465-4df9-b272-c63b14c1dc88 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:13.423650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da81672d-9465-4df9-b272-c63b14c1dc88 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:13.424625 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da81672d-9465-4df9-b272-c63b14c1dc88 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:13.425336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da81672d-9465-4df9-b272-c63b14c1dc88 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:13.426338 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da81672d-9465-4df9-b272-c63b14c1dc88 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:13.427071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da81672d-9465-4df9-b272-c63b14c1dc88 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:13.427725 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da81672d-9465-4df9-b272-c63b14c1dc88 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:13.434538 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-27424ed3-b953-4465-943f-8050af820e74 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:13.448046 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-27424ed3-b953-4465-943f-8050af820e74 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.500001 Sep 06 16:16:13.458561 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 21/41] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:12 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:13.464574 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-751badb5-130f-4a0c-bfed-c3182392fb3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:13.465621 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-751badb5-130f-4a0c-bfed-c3182392fb3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:13.491922 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-751badb5-130f-4a0c-bfed-c3182392fb3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:13.492660 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-751badb5-130f-4a0c-bfed-c3182392fb3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:13.493132 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-751badb5-130f-4a0c-bfed-c3182392fb3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:13.493830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-751badb5-130f-4a0c-bfed-c3182392fb3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:13.494466 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-751badb5-130f-4a0c-bfed-c3182392fb3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:13.495039 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-751badb5-130f-4a0c-bfed-c3182392fb3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:13.540398 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-da81672d-9465-4df9-b272-c63b14c1dc88 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:13.551870 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-da81672d-9465-4df9-b272-c63b14c1dc88 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.146597 Sep 06 16:16:13.561624 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 21/42] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:13 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:13.577969 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-751badb5-130f-4a0c-bfed-c3182392fb3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:13.589729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-751badb5-130f-4a0c-bfed-c3182392fb3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:13.591062 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-751badb5-130f-4a0c-bfed-c3182392fb3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:13.592331 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-751badb5-130f-4a0c-bfed-c3182392fb3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.132573 Sep 06 16:16:13.593138 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 22/43] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:13 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:14.417867 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e5c22b4e-faf6-40b3-8e9e-a83099d54ba3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:14.418473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e5c22b4e-faf6-40b3-8e9e-a83099d54ba3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:14.424482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e5c22b4e-faf6-40b3-8e9e-a83099d54ba3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:14.425049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e5c22b4e-faf6-40b3-8e9e-a83099d54ba3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:14.425542 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e5c22b4e-faf6-40b3-8e9e-a83099d54ba3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:14.426181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e5c22b4e-faf6-40b3-8e9e-a83099d54ba3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:14.426758 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e5c22b4e-faf6-40b3-8e9e-a83099d54ba3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:14.427182 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e5c22b4e-faf6-40b3-8e9e-a83099d54ba3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:14.483743 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6d6f5da3-3f9c-4e1a-be7f-4ba81c537b47 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:14.484358 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6d6f5da3-3f9c-4e1a-be7f-4ba81c537b47 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:14.492020 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6d6f5da3-3f9c-4e1a-be7f-4ba81c537b47 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:14.492516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6d6f5da3-3f9c-4e1a-be7f-4ba81c537b47 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:14.497374 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6d6f5da3-3f9c-4e1a-be7f-4ba81c537b47 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:14.501208 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6d6f5da3-3f9c-4e1a-be7f-4ba81c537b47 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:14.501208 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6d6f5da3-3f9c-4e1a-be7f-4ba81c537b47 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:14.501208 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6d6f5da3-3f9c-4e1a-be7f-4ba81c537b47 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:14.600389 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e5c22b4e-faf6-40b3-8e9e-a83099d54ba3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:14.608704 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e5c22b4e-faf6-40b3-8e9e-a83099d54ba3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.194778 Sep 06 16:16:14.611889 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 22/44] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:14 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:14.627027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7ae3a9f4-8c54-493c-8275-781d2dd4e1e1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:14.627896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7ae3a9f4-8c54-493c-8275-781d2dd4e1e1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:14.634294 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ae3a9f4-8c54-493c-8275-781d2dd4e1e1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:14.634868 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ae3a9f4-8c54-493c-8275-781d2dd4e1e1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:14.635578 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ae3a9f4-8c54-493c-8275-781d2dd4e1e1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:14.636475 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ae3a9f4-8c54-493c-8275-781d2dd4e1e1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:14.637164 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ae3a9f4-8c54-493c-8275-781d2dd4e1e1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:14.638020 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ae3a9f4-8c54-493c-8275-781d2dd4e1e1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:14.687335 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6d6f5da3-3f9c-4e1a-be7f-4ba81c537b47 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:14.698564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6d6f5da3-3f9c-4e1a-be7f-4ba81c537b47 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.218558 Sep 06 16:16:14.701642 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 23/45] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:14 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:14.721469 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7ae3a9f4-8c54-493c-8275-781d2dd4e1e1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:14.729087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-deed0ccf-3294-4e0d-b219-4b5881b71b26 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:14.733633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-deed0ccf-3294-4e0d-b219-4b5881b71b26 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:14.741886 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7ae3a9f4-8c54-493c-8275-781d2dd4e1e1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.128716 Sep 06 16:16:14.742778 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 23/46] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:14 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:14.750449 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-deed0ccf-3294-4e0d-b219-4b5881b71b26 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:14.750995 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-deed0ccf-3294-4e0d-b219-4b5881b71b26 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:14.751488 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-deed0ccf-3294-4e0d-b219-4b5881b71b26 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:14.752246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-deed0ccf-3294-4e0d-b219-4b5881b71b26 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:14.752783 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-deed0ccf-3294-4e0d-b219-4b5881b71b26 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:14.753306 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-deed0ccf-3294-4e0d-b219-4b5881b71b26 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:14.818934 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-deed0ccf-3294-4e0d-b219-4b5881b71b26 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:14.827583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-deed0ccf-3294-4e0d-b219-4b5881b71b26 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:14.829143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-deed0ccf-3294-4e0d-b219-4b5881b71b26 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:14.830344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-deed0ccf-3294-4e0d-b219-4b5881b71b26 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.127519 Sep 06 16:16:14.830949 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 24/47] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:14 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:15.631459 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a988bc7d-c698-4517-a301-278802709a3d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:15.632664 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a988bc7d-c698-4517-a301-278802709a3d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:15.639507 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a988bc7d-c698-4517-a301-278802709a3d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:15.640173 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a988bc7d-c698-4517-a301-278802709a3d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:15.640665 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a988bc7d-c698-4517-a301-278802709a3d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:15.641972 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a988bc7d-c698-4517-a301-278802709a3d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:15.642669 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a988bc7d-c698-4517-a301-278802709a3d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:15.643166 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a988bc7d-c698-4517-a301-278802709a3d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:15.724419 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-94d8d569-c717-4d80-8f95-da6eeb28b895 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:15.725073 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-94d8d569-c717-4d80-8f95-da6eeb28b895 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:15.732161 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-94d8d569-c717-4d80-8f95-da6eeb28b895 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:15.732583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-94d8d569-c717-4d80-8f95-da6eeb28b895 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:15.733151 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-94d8d569-c717-4d80-8f95-da6eeb28b895 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:15.733962 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-94d8d569-c717-4d80-8f95-da6eeb28b895 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:15.734512 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-94d8d569-c717-4d80-8f95-da6eeb28b895 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:15.735013 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-94d8d569-c717-4d80-8f95-da6eeb28b895 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:15.791536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a988bc7d-c698-4517-a301-278802709a3d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:15.799568 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a988bc7d-c698-4517-a301-278802709a3d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.171989 Sep 06 16:16:15.800637 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 24/48] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:15 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:15.805744 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-64d208f3-30b8-46c5-9512-06766757675c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:15.806606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-64d208f3-30b8-46c5-9512-06766757675c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:15.812852 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64d208f3-30b8-46c5-9512-06766757675c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:15.813778 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64d208f3-30b8-46c5-9512-06766757675c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:15.814322 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64d208f3-30b8-46c5-9512-06766757675c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:15.815254 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64d208f3-30b8-46c5-9512-06766757675c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:15.815916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64d208f3-30b8-46c5-9512-06766757675c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:15.816434 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64d208f3-30b8-46c5-9512-06766757675c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:15.880226 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-94d8d569-c717-4d80-8f95-da6eeb28b895 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:15.881610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-64d208f3-30b8-46c5-9512-06766757675c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:15.888145 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-94d8d569-c717-4d80-8f95-da6eeb28b895 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.167844 Sep 06 16:16:15.889125 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 25/49] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:15 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:15.901248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-64d208f3-30b8-46c5-9512-06766757675c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.089299 Sep 06 16:16:15.901248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 25/50] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:15 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:15.905330 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f5297637-f5bf-4a73-95b2-1e422ba0bde3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:15.906053 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f5297637-f5bf-4a73-95b2-1e422ba0bde3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:15.912593 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5297637-f5bf-4a73-95b2-1e422ba0bde3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:15.913105 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5297637-f5bf-4a73-95b2-1e422ba0bde3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:15.913588 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5297637-f5bf-4a73-95b2-1e422ba0bde3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:15.914273 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5297637-f5bf-4a73-95b2-1e422ba0bde3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:15.914711 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5297637-f5bf-4a73-95b2-1e422ba0bde3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:15.915125 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5297637-f5bf-4a73-95b2-1e422ba0bde3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:15.988421 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f5297637-f5bf-4a73-95b2-1e422ba0bde3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:15.997075 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f5297637-f5bf-4a73-95b2-1e422ba0bde3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:15.998533 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f5297637-f5bf-4a73-95b2-1e422ba0bde3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:15.999605 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f5297637-f5bf-4a73-95b2-1e422ba0bde3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.106856 Sep 06 16:16:16.000166 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 26/51] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:15 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:16.823804 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fb6068eb-6264-4dd0-801d-7e645d04455f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:16.824502 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fb6068eb-6264-4dd0-801d-7e645d04455f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:16.827632 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:16.831597 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb6068eb-6264-4dd0-801d-7e645d04455f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:16.832083 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb6068eb-6264-4dd0-801d-7e645d04455f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:16.832589 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb6068eb-6264-4dd0-801d-7e645d04455f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:16.833398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb6068eb-6264-4dd0-801d-7e645d04455f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:16.833830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb6068eb-6264-4dd0-801d-7e645d04455f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:16.834273 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb6068eb-6264-4dd0-801d-7e645d04455f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:16.912696 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c1d0c8cf-2409-42e6-a392-f343350b7b9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:16.913279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c1d0c8cf-2409-42e6-a392-f343350b7b9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:16.919632 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c1d0c8cf-2409-42e6-a392-f343350b7b9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:16.920122 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c1d0c8cf-2409-42e6-a392-f343350b7b9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:16.920616 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c1d0c8cf-2409-42e6-a392-f343350b7b9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:16.921269 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c1d0c8cf-2409-42e6-a392-f343350b7b9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:16.921722 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c1d0c8cf-2409-42e6-a392-f343350b7b9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:16.922149 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c1d0c8cf-2409-42e6-a392-f343350b7b9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:16.982390 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fb6068eb-6264-4dd0-801d-7e645d04455f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:16.990935 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fb6068eb-6264-4dd0-801d-7e645d04455f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.170989 Sep 06 16:16:16.991696 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 26/52] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:16 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:16.997246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-951f2d92-3459-4709-a43a-3f977032bb00 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:16.997869 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-951f2d92-3459-4709-a43a-3f977032bb00 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:17.004216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-951f2d92-3459-4709-a43a-3f977032bb00 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:17.004704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-951f2d92-3459-4709-a43a-3f977032bb00 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:17.005179 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-951f2d92-3459-4709-a43a-3f977032bb00 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:17.005896 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-951f2d92-3459-4709-a43a-3f977032bb00 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:17.006357 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-951f2d92-3459-4709-a43a-3f977032bb00 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:17.006801 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-951f2d92-3459-4709-a43a-3f977032bb00 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:17.101548 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-951f2d92-3459-4709-a43a-3f977032bb00 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:17.109776 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-951f2d92-3459-4709-a43a-3f977032bb00 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.116895 Sep 06 16:16:17.110370 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 27/53] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:16 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:17.115362 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-60c6ecdb-18dd-48a3-9ed8-5c77ce6408ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:17.115966 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-60c6ecdb-18dd-48a3-9ed8-5c77ce6408ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:17.122137 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60c6ecdb-18dd-48a3-9ed8-5c77ce6408ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:17.122620 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60c6ecdb-18dd-48a3-9ed8-5c77ce6408ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:17.123049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60c6ecdb-18dd-48a3-9ed8-5c77ce6408ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:17.123769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60c6ecdb-18dd-48a3-9ed8-5c77ce6408ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:17.124218 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60c6ecdb-18dd-48a3-9ed8-5c77ce6408ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:17.124637 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60c6ecdb-18dd-48a3-9ed8-5c77ce6408ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:17.191486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-60c6ecdb-18dd-48a3-9ed8-5c77ce6408ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:17.205088 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-60c6ecdb-18dd-48a3-9ed8-5c77ce6408ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:17.206794 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-60c6ecdb-18dd-48a3-9ed8-5c77ce6408ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:17.208090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-60c6ecdb-18dd-48a3-9ed8-5c77ce6408ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.096802 Sep 06 16:16:17.208807 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 28/54] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:17 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:17.222551 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c1d0c8cf-2409-42e6-a392-f343350b7b9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:17.230600 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c1d0c8cf-2409-42e6-a392-f343350b7b9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.321882 Sep 06 16:16:17.231175 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 27/55] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:16 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:18.014340 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-573fa581-da2f-4566-8b21-b809ac5fa418 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:18.014961 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-573fa581-da2f-4566-8b21-b809ac5fa418 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:18.020280 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=4 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:18.022135 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-573fa581-da2f-4566-8b21-b809ac5fa418 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:18.022635 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-573fa581-da2f-4566-8b21-b809ac5fa418 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:18.023093 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-573fa581-da2f-4566-8b21-b809ac5fa418 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:18.023873 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-573fa581-da2f-4566-8b21-b809ac5fa418 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:18.024327 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-573fa581-da2f-4566-8b21-b809ac5fa418 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:18.024741 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-573fa581-da2f-4566-8b21-b809ac5fa418 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:18.133177 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6640048c-3faf-4f85-b8d6-9d327cd617d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:18.134136 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6640048c-3faf-4f85-b8d6-9d327cd617d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:18.143819 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6640048c-3faf-4f85-b8d6-9d327cd617d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:18.144332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6640048c-3faf-4f85-b8d6-9d327cd617d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:18.144863 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6640048c-3faf-4f85-b8d6-9d327cd617d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:18.145540 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6640048c-3faf-4f85-b8d6-9d327cd617d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:18.145992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6640048c-3faf-4f85-b8d6-9d327cd617d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:18.146415 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6640048c-3faf-4f85-b8d6-9d327cd617d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:18.241724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6640048c-3faf-4f85-b8d6-9d327cd617d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:18.243062 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-573fa581-da2f-4566-8b21-b809ac5fa418 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:18.248281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:18.253344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-573fa581-da2f-4566-8b21-b809ac5fa418 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.242805 Sep 06 16:16:18.254482 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 29/56] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:18 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:18.259826 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-83af97f7-edb8-4f74-b054-0c13eb423f52 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:18.260739 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-83af97f7-edb8-4f74-b054-0c13eb423f52 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:18.268049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6640048c-3faf-4f85-b8d6-9d327cd617d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.135967 Sep 06 16:16:18.269946 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 28/57] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:18 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:18.270543 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83af97f7-edb8-4f74-b054-0c13eb423f52 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:18.271578 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83af97f7-edb8-4f74-b054-0c13eb423f52 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:18.272720 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83af97f7-edb8-4f74-b054-0c13eb423f52 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:18.273990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83af97f7-edb8-4f74-b054-0c13eb423f52 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:18.274923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83af97f7-edb8-4f74-b054-0c13eb423f52 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:18.275595 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7d179d9b-9d6c-434e-a795-4e827793bdee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:18.276065 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83af97f7-edb8-4f74-b054-0c13eb423f52 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:18.276333 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7d179d9b-9d6c-434e-a795-4e827793bdee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:18.284801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7d179d9b-9d6c-434e-a795-4e827793bdee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:18.285295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7d179d9b-9d6c-434e-a795-4e827793bdee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:18.285865 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7d179d9b-9d6c-434e-a795-4e827793bdee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:18.287012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7d179d9b-9d6c-434e-a795-4e827793bdee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:18.287628 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7d179d9b-9d6c-434e-a795-4e827793bdee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:18.288194 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7d179d9b-9d6c-434e-a795-4e827793bdee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:18.346540 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-83af97f7-edb8-4f74-b054-0c13eb423f52 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:18.363951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-83af97f7-edb8-4f74-b054-0c13eb423f52 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:18.366261 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-83af97f7-edb8-4f74-b054-0c13eb423f52 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:18.367895 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-83af97f7-edb8-4f74-b054-0c13eb423f52 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.112190 Sep 06 16:16:18.369251 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 30/58] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:18 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:18.459425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7d179d9b-9d6c-434e-a795-4e827793bdee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:18.468741 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7d179d9b-9d6c-434e-a795-4e827793bdee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.197462 Sep 06 16:16:18.469621 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 29/59] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:18 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:19.277320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e6303a0a-46d6-42de-bd30-51d4dd738b69 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:19.278522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e6303a0a-46d6-42de-bd30-51d4dd738b69 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:19.284452 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e6303a0a-46d6-42de-bd30-51d4dd738b69 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:19.285107 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e6303a0a-46d6-42de-bd30-51d4dd738b69 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:19.286665 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e6303a0a-46d6-42de-bd30-51d4dd738b69 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:19.287042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e6303a0a-46d6-42de-bd30-51d4dd738b69 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:19.287691 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e6303a0a-46d6-42de-bd30-51d4dd738b69 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:19.288264 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e6303a0a-46d6-42de-bd30-51d4dd738b69 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:19.292181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d50cb69b-ac5e-4792-afd0-ad72afc1c14d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:19.292598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d50cb69b-ac5e-4792-afd0-ad72afc1c14d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:19.298419 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=6 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:19.300118 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d50cb69b-ac5e-4792-afd0-ad72afc1c14d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:19.300999 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d50cb69b-ac5e-4792-afd0-ad72afc1c14d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:19.301779 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d50cb69b-ac5e-4792-afd0-ad72afc1c14d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:19.302577 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d50cb69b-ac5e-4792-afd0-ad72afc1c14d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:19.303147 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d50cb69b-ac5e-4792-afd0-ad72afc1c14d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:19.303573 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d50cb69b-ac5e-4792-afd0-ad72afc1c14d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:19.325200 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=20 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:19.332404 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:19.401677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d50cb69b-ac5e-4792-afd0-ad72afc1c14d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:19.426603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d50cb69b-ac5e-4792-afd0-ad72afc1c14d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.138685 Sep 06 16:16:19.427143 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 30/60] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:19 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:19.431875 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e914e0e9-e53b-4df1-abeb-ec297e0666af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:19.432486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e914e0e9-e53b-4df1-abeb-ec297e0666af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:19.443823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e914e0e9-e53b-4df1-abeb-ec297e0666af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:19.444376 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e914e0e9-e53b-4df1-abeb-ec297e0666af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:19.445093 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e914e0e9-e53b-4df1-abeb-ec297e0666af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:19.445991 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e914e0e9-e53b-4df1-abeb-ec297e0666af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:19.446597 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e914e0e9-e53b-4df1-abeb-ec297e0666af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:19.447451 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e914e0e9-e53b-4df1-abeb-ec297e0666af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:19.507543 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e6303a0a-46d6-42de-bd30-51d4dd738b69 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:19.519866 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e6303a0a-46d6-42de-bd30-51d4dd738b69 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.246950 Sep 06 16:16:19.520949 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 31/61] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:19 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:19.525880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5bcad1f7-5bb9-4e13-a452-4cdb017b8e01 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:19.526769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5bcad1f7-5bb9-4e13-a452-4cdb017b8e01 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:19.533226 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5bcad1f7-5bb9-4e13-a452-4cdb017b8e01 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:19.534005 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5bcad1f7-5bb9-4e13-a452-4cdb017b8e01 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:19.534658 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5bcad1f7-5bb9-4e13-a452-4cdb017b8e01 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:19.535548 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5bcad1f7-5bb9-4e13-a452-4cdb017b8e01 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:19.536207 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5bcad1f7-5bb9-4e13-a452-4cdb017b8e01 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:19.536686 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5bcad1f7-5bb9-4e13-a452-4cdb017b8e01 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:19.546999 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e914e0e9-e53b-4df1-abeb-ec297e0666af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:19.556145 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e914e0e9-e53b-4df1-abeb-ec297e0666af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:19.557658 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e914e0e9-e53b-4df1-abeb-ec297e0666af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:19.558772 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e914e0e9-e53b-4df1-abeb-ec297e0666af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.130701 Sep 06 16:16:19.559476 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 31/62] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:19 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:19.564542 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1699b576-8226-456d-b17a-5821b7379941 tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] Calling method '.version_select at 0x7f83e98bb940>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:19.604090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=28 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:19.614591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1699b576-8226-456d-b17a-5821b7379941 tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/067a3004-23bd-4582-bb44-c603a91a705c" status: 200 len: 350 microversion: 2.1 time: 0.053700 Sep 06 16:16:19.615194 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 32/63] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:16:19 2022] GET /compute/v2.1/os-volumes/067a3004-23bd-4582-bb44-c603a91a705c => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:16:19.631304 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-aaf264d1-daf2-4e20-ad27-656950dea0bc tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] Calling method '.version_select at 0x7f83e98bbaf0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:19.720103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5bcad1f7-5bb9-4e13-a452-4cdb017b8e01 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:19.728447 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5bcad1f7-5bb9-4e13-a452-4cdb017b8e01 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.206135 Sep 06 16:16:19.738427 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 32/64] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:19 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:19.738593 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-aaf264d1-daf2-4e20-ad27-656950dea0bc tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.111629 Sep 06 16:16:19.739243 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 33/65] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Sep 6 16:16:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:19.753860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-250f524c-dd29-4de0-b609-0fb3f4707d3b tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] Calling method '.version_select at 0x7f83e9960f70>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:19.844501 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-250f524c-dd29-4de0-b609-0fb3f4707d3b tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094732 Sep 06 16:16:19.846733 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 33/66] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Sep 6 16:16:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:16:19.859276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c96f0f18-74d4-4a6b-af0e-c497216b565b tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] Calling method '.version_select at 0x7f83e988ef70>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:19.946290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c96f0f18-74d4-4a6b-af0e-c497216b565b tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091213 Sep 06 16:16:19.946858 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 34/67] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Sep 6 16:16:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:19.964300 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-49e315b7-bbdf-4ba7-807e-fdddd523f0ad tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] Calling method '.version_select at 0x7f83e99731f0>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:20.070282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-49e315b7-bbdf-4ba7-807e-fdddd523f0ad tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.113062 Sep 06 16:16:20.071418 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 34/68] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Sep 6 16:16:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:16:20.087652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-aec88bfc-1d3f-4938-bb33-c7c4b84ec1a5 tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] Calling method '.version_select at 0x7f83e98e5790>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:20.180106 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-aec88bfc-1d3f-4938-bb33-c7c4b84ec1a5 tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.096884 Sep 06 16:16:20.186754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 35/69] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Sep 6 16:16:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:16:20.199638 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c4bfc0c5-324f-443e-86c8-6531772198d6 tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] Calling method '.version_select at 0x7f83e9973310>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:20.338777 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c4bfc0c5-324f-443e-86c8-6531772198d6 tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.143478 Sep 06 16:16:20.339914 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 35/70] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Sep 6 16:16:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:20.353276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7a0b4fcf-ffcf-4f4b-91c2-67af2e791c35 tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] Calling method '.version_select at 0x7f83e991a5e0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:20.450291 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-edb520fb-f774-49e3-8afe-8ca643ed5161 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:20.451411 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-edb520fb-f774-49e3-8afe-8ca643ed5161 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:20.470960 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-edb520fb-f774-49e3-8afe-8ca643ed5161 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:20.473647 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-edb520fb-f774-49e3-8afe-8ca643ed5161 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:20.474763 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-edb520fb-f774-49e3-8afe-8ca643ed5161 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:20.478312 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-edb520fb-f774-49e3-8afe-8ca643ed5161 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:20.478995 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-edb520fb-f774-49e3-8afe-8ca643ed5161 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:20.479869 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7a0b4fcf-ffcf-4f4b-91c2-67af2e791c35 tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.130775 Sep 06 16:16:20.480462 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 36/71] 10.222.0.43 () {58 vars in 1188 bytes} [Tue Sep 6 16:16:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:16:20.489622 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-edb520fb-f774-49e3-8afe-8ca643ed5161 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:20.512094 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-69840516-87a5-49bf-bba0-83c8e8b25ba9 tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] Calling method '.version_select at 0x7f83e988e430>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:20.609623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-edb520fb-f774-49e3-8afe-8ca643ed5161 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:20.626034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-edb520fb-f774-49e3-8afe-8ca643ed5161 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.179281 Sep 06 16:16:20.635467 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 36/72] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:20 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:20.645733 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-43be0d2b-e031-4fa9-a29d-d3c1b6670daa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:20.646347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-43be0d2b-e031-4fa9-a29d-d3c1b6670daa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:20.659521 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-69840516-87a5-49bf-bba0-83c8e8b25ba9 tempest-VolumesTestJSON-1699392806 tempest-VolumesTestJSON-1699392806-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.166746 Sep 06 16:16:20.660321 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 37/73] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Sep 6 16:16:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:20.666236 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-53b60a78-e61b-4904-a2e5-1f1e9d5d4122 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:20.667006 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-53b60a78-e61b-4904-a2e5-1f1e9d5d4122 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:20.675208 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-53b60a78-e61b-4904-a2e5-1f1e9d5d4122 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:20.676087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-53b60a78-e61b-4904-a2e5-1f1e9d5d4122 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:20.676729 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-53b60a78-e61b-4904-a2e5-1f1e9d5d4122 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:20.677647 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-53b60a78-e61b-4904-a2e5-1f1e9d5d4122 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:20.678464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-53b60a78-e61b-4904-a2e5-1f1e9d5d4122 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:20.680690 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-43be0d2b-e031-4fa9-a29d-d3c1b6670daa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:20.681448 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-43be0d2b-e031-4fa9-a29d-d3c1b6670daa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:20.682460 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-43be0d2b-e031-4fa9-a29d-d3c1b6670daa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:20.683984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-43be0d2b-e031-4fa9-a29d-d3c1b6670daa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:20.684575 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-43be0d2b-e031-4fa9-a29d-d3c1b6670daa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:20.685183 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-43be0d2b-e031-4fa9-a29d-d3c1b6670daa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:20.685394 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-53b60a78-e61b-4904-a2e5-1f1e9d5d4122 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:20.782143 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-53b60a78-e61b-4904-a2e5-1f1e9d5d4122 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:20.795862 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-53b60a78-e61b-4904-a2e5-1f1e9d5d4122 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:20.797566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-53b60a78-e61b-4904-a2e5-1f1e9d5d4122 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:20.798643 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-53b60a78-e61b-4904-a2e5-1f1e9d5d4122 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.137204 Sep 06 16:16:20.813895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:20 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:20.824879 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ca8c2f66-ccd6-4c4e-91f5-02a580c953ab tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:20.825940 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ca8c2f66-ccd6-4c4e-91f5-02a580c953ab tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:20.833104 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ca8c2f66-ccd6-4c4e-91f5-02a580c953ab tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:20.834425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ca8c2f66-ccd6-4c4e-91f5-02a580c953ab tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:20.835241 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ca8c2f66-ccd6-4c4e-91f5-02a580c953ab tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:20.836181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ca8c2f66-ccd6-4c4e-91f5-02a580c953ab tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:20.836865 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ca8c2f66-ccd6-4c4e-91f5-02a580c953ab tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:20.837520 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ca8c2f66-ccd6-4c4e-91f5-02a580c953ab tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:20.956574 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-43be0d2b-e031-4fa9-a29d-d3c1b6670daa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:20.965950 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-43be0d2b-e031-4fa9-a29d-d3c1b6670daa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.329020 Sep 06 16:16:20.966824 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 37/75] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:20 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:21.057117 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ca8c2f66-ccd6-4c4e-91f5-02a580c953ab tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:21.066261 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ca8c2f66-ccd6-4c4e-91f5-02a580c953ab tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.250820 Sep 06 16:16:21.066923 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 39/76] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:20 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:21.654007 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-733b3d6c-cb95-4975-9489-99e128b0640f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:21.654606 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-733b3d6c-cb95-4975-9489-99e128b0640f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:21.663124 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-733b3d6c-cb95-4975-9489-99e128b0640f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:21.663616 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-733b3d6c-cb95-4975-9489-99e128b0640f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:21.664061 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-733b3d6c-cb95-4975-9489-99e128b0640f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:21.664816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-733b3d6c-cb95-4975-9489-99e128b0640f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:21.665245 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-733b3d6c-cb95-4975-9489-99e128b0640f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:21.665655 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-733b3d6c-cb95-4975-9489-99e128b0640f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:21.751941 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-733b3d6c-cb95-4975-9489-99e128b0640f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:21.761567 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-733b3d6c-cb95-4975-9489-99e128b0640f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.111302 Sep 06 16:16:21.762356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 38/77] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:21 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:21.828132 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-efb57846-0fbd-48bd-aea6-97f585480259 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:21.828777 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-efb57846-0fbd-48bd-aea6-97f585480259 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:21.835359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-efb57846-0fbd-48bd-aea6-97f585480259 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:21.836250 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-efb57846-0fbd-48bd-aea6-97f585480259 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:21.837213 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-efb57846-0fbd-48bd-aea6-97f585480259 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:21.838824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-efb57846-0fbd-48bd-aea6-97f585480259 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:21.839456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-efb57846-0fbd-48bd-aea6-97f585480259 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:21.855856 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-efb57846-0fbd-48bd-aea6-97f585480259 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:21.966759 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-efb57846-0fbd-48bd-aea6-97f585480259 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:21.977513 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-efb57846-0fbd-48bd-aea6-97f585480259 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:21.996677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-efb57846-0fbd-48bd-aea6-97f585480259 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:22.000732 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-efb57846-0fbd-48bd-aea6-97f585480259 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.175846 Sep 06 16:16:22.001593 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 40/78] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:21 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:22.009383 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-da58eae9-7759-4c2b-a47f-098f29081906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:22.009998 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-da58eae9-7759-4c2b-a47f-098f29081906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:22.016955 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-da58eae9-7759-4c2b-a47f-098f29081906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:22.017456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-da58eae9-7759-4c2b-a47f-098f29081906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:22.018068 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-da58eae9-7759-4c2b-a47f-098f29081906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:22.018789 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-da58eae9-7759-4c2b-a47f-098f29081906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:22.019254 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-da58eae9-7759-4c2b-a47f-098f29081906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:22.019678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-da58eae9-7759-4c2b-a47f-098f29081906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:22.090844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d563eb65-4d96-401b-8bef-4efcb309d41a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:22.092087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d563eb65-4d96-401b-8bef-4efcb309d41a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:22.104865 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d563eb65-4d96-401b-8bef-4efcb309d41a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:22.106118 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d563eb65-4d96-401b-8bef-4efcb309d41a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:22.106628 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d563eb65-4d96-401b-8bef-4efcb309d41a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:22.107567 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d563eb65-4d96-401b-8bef-4efcb309d41a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:22.108092 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d563eb65-4d96-401b-8bef-4efcb309d41a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:22.109417 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d563eb65-4d96-401b-8bef-4efcb309d41a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:22.241010 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-da58eae9-7759-4c2b-a47f-098f29081906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:22.251338 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-da58eae9-7759-4c2b-a47f-098f29081906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.251341 Sep 06 16:16:22.251851 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 39/79] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:21 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:22.318504 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d563eb65-4d96-401b-8bef-4efcb309d41a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:22.326453 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d563eb65-4d96-401b-8bef-4efcb309d41a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.240719 Sep 06 16:16:22.327032 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 41/80] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:22 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:22.788375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ff9a5804-5fc7-47d1-888b-eb97f8dc3eda tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:22.790205 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ff9a5804-5fc7-47d1-888b-eb97f8dc3eda tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:22.797751 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ff9a5804-5fc7-47d1-888b-eb97f8dc3eda tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:22.798567 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ff9a5804-5fc7-47d1-888b-eb97f8dc3eda tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:22.799181 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ff9a5804-5fc7-47d1-888b-eb97f8dc3eda tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:22.800634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ff9a5804-5fc7-47d1-888b-eb97f8dc3eda tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:22.801475 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ff9a5804-5fc7-47d1-888b-eb97f8dc3eda tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:22.802794 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ff9a5804-5fc7-47d1-888b-eb97f8dc3eda tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:22.905941 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ff9a5804-5fc7-47d1-888b-eb97f8dc3eda tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:22.914596 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ff9a5804-5fc7-47d1-888b-eb97f8dc3eda tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.131492 Sep 06 16:16:22.915186 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 40/81] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:22 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:23.029940 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-47bb0ed3-2d87-4fc0-ab1d-063b603a392b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:23.031202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-47bb0ed3-2d87-4fc0-ab1d-063b603a392b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:23.037406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47bb0ed3-2d87-4fc0-ab1d-063b603a392b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:23.037890 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47bb0ed3-2d87-4fc0-ab1d-063b603a392b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:23.038390 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47bb0ed3-2d87-4fc0-ab1d-063b603a392b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:23.039137 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47bb0ed3-2d87-4fc0-ab1d-063b603a392b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:23.039768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47bb0ed3-2d87-4fc0-ab1d-063b603a392b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:23.040192 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47bb0ed3-2d87-4fc0-ab1d-063b603a392b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:23.130480 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-47bb0ed3-2d87-4fc0-ab1d-063b603a392b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:23.140918 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-47bb0ed3-2d87-4fc0-ab1d-063b603a392b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:23.142776 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-47bb0ed3-2d87-4fc0-ab1d-063b603a392b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:23.144065 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-47bb0ed3-2d87-4fc0-ab1d-063b603a392b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.120113 Sep 06 16:16:23.144687 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 42/82] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:23 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:23.276586 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a5cc0a0d-dc67-4cf0-9be6-43e9cd68510f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:23.277163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a5cc0a0d-dc67-4cf0-9be6-43e9cd68510f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:23.283552 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5cc0a0d-dc67-4cf0-9be6-43e9cd68510f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:23.284049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5cc0a0d-dc67-4cf0-9be6-43e9cd68510f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:23.284479 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5cc0a0d-dc67-4cf0-9be6-43e9cd68510f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:23.285486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5cc0a0d-dc67-4cf0-9be6-43e9cd68510f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:23.285956 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5cc0a0d-dc67-4cf0-9be6-43e9cd68510f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:23.286357 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5cc0a0d-dc67-4cf0-9be6-43e9cd68510f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:23.350886 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-98d62c8c-02d0-4c14-889e-d3dbc10490cf tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:23.352008 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-98d62c8c-02d0-4c14-889e-d3dbc10490cf tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:23.355040 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:23.358988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-98d62c8c-02d0-4c14-889e-d3dbc10490cf tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:23.360231 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-98d62c8c-02d0-4c14-889e-d3dbc10490cf tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:23.361355 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-98d62c8c-02d0-4c14-889e-d3dbc10490cf tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:23.362282 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-98d62c8c-02d0-4c14-889e-d3dbc10490cf tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:23.362861 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-98d62c8c-02d0-4c14-889e-d3dbc10490cf tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:23.364121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-98d62c8c-02d0-4c14-889e-d3dbc10490cf tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:23.435771 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a5cc0a0d-dc67-4cf0-9be6-43e9cd68510f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:23.461415 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a5cc0a0d-dc67-4cf0-9be6-43e9cd68510f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.190670 Sep 06 16:16:23.462201 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 41/83] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:23 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:23.519284 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-98d62c8c-02d0-4c14-889e-d3dbc10490cf tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:23.527602 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-98d62c8c-02d0-4c14-889e-d3dbc10490cf tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.181788 Sep 06 16:16:23.528355 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 43/84] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:23 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:23.937909 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b27bf62a-2eae-4238-9547-c413fc18e31d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:23.938991 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b27bf62a-2eae-4238-9547-c413fc18e31d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:23.946025 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b27bf62a-2eae-4238-9547-c413fc18e31d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:23.946583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b27bf62a-2eae-4238-9547-c413fc18e31d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:23.947006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b27bf62a-2eae-4238-9547-c413fc18e31d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:23.947664 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b27bf62a-2eae-4238-9547-c413fc18e31d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:23.948314 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b27bf62a-2eae-4238-9547-c413fc18e31d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:23.948730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b27bf62a-2eae-4238-9547-c413fc18e31d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:24.048276 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b27bf62a-2eae-4238-9547-c413fc18e31d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:24.056863 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b27bf62a-2eae-4238-9547-c413fc18e31d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.123063 Sep 06 16:16:24.057834 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 42/85] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:23 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:24.170872 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-387eb4bb-3c27-41f4-bbc6-c4222189837f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:24.172164 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-387eb4bb-3c27-41f4-bbc6-c4222189837f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:24.179588 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-387eb4bb-3c27-41f4-bbc6-c4222189837f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:24.180307 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-387eb4bb-3c27-41f4-bbc6-c4222189837f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:24.180975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-387eb4bb-3c27-41f4-bbc6-c4222189837f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:24.181790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-387eb4bb-3c27-41f4-bbc6-c4222189837f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:24.182510 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-387eb4bb-3c27-41f4-bbc6-c4222189837f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:24.183071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-387eb4bb-3c27-41f4-bbc6-c4222189837f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:24.260001 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-387eb4bb-3c27-41f4-bbc6-c4222189837f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:24.268944 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-387eb4bb-3c27-41f4-bbc6-c4222189837f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:24.270313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-387eb4bb-3c27-41f4-bbc6-c4222189837f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:24.271424 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-387eb4bb-3c27-41f4-bbc6-c4222189837f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.104617 Sep 06 16:16:24.272380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 44/86] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:24 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:24.491913 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2e54ad24-f5ef-40ca-8fff-890dfa190842 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:24.492521 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2e54ad24-f5ef-40ca-8fff-890dfa190842 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:24.498947 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e54ad24-f5ef-40ca-8fff-890dfa190842 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:24.499665 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e54ad24-f5ef-40ca-8fff-890dfa190842 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:24.500263 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e54ad24-f5ef-40ca-8fff-890dfa190842 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:24.501162 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e54ad24-f5ef-40ca-8fff-890dfa190842 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:24.501769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e54ad24-f5ef-40ca-8fff-890dfa190842 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:24.502443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e54ad24-f5ef-40ca-8fff-890dfa190842 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:24.552159 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c594cef6-25b0-454c-b300-c3660818e9d6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:24.553480 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c594cef6-25b0-454c-b300-c3660818e9d6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:24.560710 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c594cef6-25b0-454c-b300-c3660818e9d6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:24.561278 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c594cef6-25b0-454c-b300-c3660818e9d6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:24.561774 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c594cef6-25b0-454c-b300-c3660818e9d6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:24.562483 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c594cef6-25b0-454c-b300-c3660818e9d6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:24.563285 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c594cef6-25b0-454c-b300-c3660818e9d6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:24.563757 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c594cef6-25b0-454c-b300-c3660818e9d6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:24.735956 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2e54ad24-f5ef-40ca-8fff-890dfa190842 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:24.746191 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c594cef6-25b0-454c-b300-c3660818e9d6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:24.747477 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2e54ad24-f5ef-40ca-8fff-890dfa190842 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.257792 Sep 06 16:16:24.748929 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 43/87] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:24 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:24.759210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c594cef6-25b0-454c-b300-c3660818e9d6 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.211971 Sep 06 16:16:24.760046 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 45/88] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:24 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:25.081152 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-251a656c-dd7b-4667-918b-116a84b270d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:25.081848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-251a656c-dd7b-4667-918b-116a84b270d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:25.088076 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-251a656c-dd7b-4667-918b-116a84b270d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:25.088570 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-251a656c-dd7b-4667-918b-116a84b270d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:25.089042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-251a656c-dd7b-4667-918b-116a84b270d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:25.089731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-251a656c-dd7b-4667-918b-116a84b270d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:25.090394 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-251a656c-dd7b-4667-918b-116a84b270d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:25.090624 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-251a656c-dd7b-4667-918b-116a84b270d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:25.203384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-251a656c-dd7b-4667-918b-116a84b270d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:25.211988 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-251a656c-dd7b-4667-918b-116a84b270d5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.134714 Sep 06 16:16:25.226337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 44/89] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:25 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:25.301562 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-16e9ccd8-0914-4946-8142-fa3bae9de21e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:25.302167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-16e9ccd8-0914-4946-8142-fa3bae9de21e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:25.308344 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-16e9ccd8-0914-4946-8142-fa3bae9de21e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:25.308921 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-16e9ccd8-0914-4946-8142-fa3bae9de21e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:25.309292 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-16e9ccd8-0914-4946-8142-fa3bae9de21e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:25.309976 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-16e9ccd8-0914-4946-8142-fa3bae9de21e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:25.310424 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-16e9ccd8-0914-4946-8142-fa3bae9de21e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:25.310850 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-16e9ccd8-0914-4946-8142-fa3bae9de21e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:25.400950 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-16e9ccd8-0914-4946-8142-fa3bae9de21e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:25.409375 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-16e9ccd8-0914-4946-8142-fa3bae9de21e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:25.410814 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-16e9ccd8-0914-4946-8142-fa3bae9de21e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:25.416863 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-16e9ccd8-0914-4946-8142-fa3bae9de21e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.114433 Sep 06 16:16:25.417527 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 46/90] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:25 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:25.771904 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0b567353-a643-4645-ba5d-47fd882dfe92 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:25.772510 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0b567353-a643-4645-ba5d-47fd882dfe92 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:25.778747 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b567353-a643-4645-ba5d-47fd882dfe92 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:25.779228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b567353-a643-4645-ba5d-47fd882dfe92 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:25.779812 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b567353-a643-4645-ba5d-47fd882dfe92 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:25.780717 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b567353-a643-4645-ba5d-47fd882dfe92 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:25.781151 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b567353-a643-4645-ba5d-47fd882dfe92 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:25.781715 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b567353-a643-4645-ba5d-47fd882dfe92 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:25.784436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-43050acf-bd8a-4648-a3b9-b0cd805afdf0 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:25.785252 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-43050acf-bd8a-4648-a3b9-b0cd805afdf0 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:25.792056 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43050acf-bd8a-4648-a3b9-b0cd805afdf0 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:25.792471 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43050acf-bd8a-4648-a3b9-b0cd805afdf0 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:25.793011 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43050acf-bd8a-4648-a3b9-b0cd805afdf0 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:25.793687 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43050acf-bd8a-4648-a3b9-b0cd805afdf0 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:25.794168 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43050acf-bd8a-4648-a3b9-b0cd805afdf0 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:25.794592 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43050acf-bd8a-4648-a3b9-b0cd805afdf0 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:25.930245 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0b567353-a643-4645-ba5d-47fd882dfe92 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:25.940656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0b567353-a643-4645-ba5d-47fd882dfe92 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.171193 Sep 06 16:16:25.953192 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 45/91] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:25 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:25.983371 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-43050acf-bd8a-4648-a3b9-b0cd805afdf0 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:25.992568 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-43050acf-bd8a-4648-a3b9-b0cd805afdf0 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.211824 Sep 06 16:16:25.992836 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 47/92] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:25 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:26.235520 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9647e5f8-ae0f-4bf5-a219-7f8af20b7699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:26.236907 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9647e5f8-ae0f-4bf5-a219-7f8af20b7699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:26.250222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9647e5f8-ae0f-4bf5-a219-7f8af20b7699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:26.251056 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9647e5f8-ae0f-4bf5-a219-7f8af20b7699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:26.251883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9647e5f8-ae0f-4bf5-a219-7f8af20b7699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:26.252842 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9647e5f8-ae0f-4bf5-a219-7f8af20b7699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:26.253492 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9647e5f8-ae0f-4bf5-a219-7f8af20b7699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:26.254110 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9647e5f8-ae0f-4bf5-a219-7f8af20b7699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:26.345536 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9647e5f8-ae0f-4bf5-a219-7f8af20b7699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:26.365910 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9647e5f8-ae0f-4bf5-a219-7f8af20b7699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.134044 Sep 06 16:16:26.381379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 46/93] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:26 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:26.441435 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-625cf5e2-44fd-41ad-8927-12ae1e779529 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:26.442130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-625cf5e2-44fd-41ad-8927-12ae1e779529 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:26.448297 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-625cf5e2-44fd-41ad-8927-12ae1e779529 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:26.448891 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-625cf5e2-44fd-41ad-8927-12ae1e779529 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:26.449514 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-625cf5e2-44fd-41ad-8927-12ae1e779529 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:26.450524 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-625cf5e2-44fd-41ad-8927-12ae1e779529 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:26.451255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-625cf5e2-44fd-41ad-8927-12ae1e779529 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:26.451920 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-625cf5e2-44fd-41ad-8927-12ae1e779529 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:26.530685 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-625cf5e2-44fd-41ad-8927-12ae1e779529 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:26.542821 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-625cf5e2-44fd-41ad-8927-12ae1e779529 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:26.545615 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-625cf5e2-44fd-41ad-8927-12ae1e779529 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:26.547345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-625cf5e2-44fd-41ad-8927-12ae1e779529 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.110292 Sep 06 16:16:26.565798 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 48/94] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:26 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:26.962293 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-47716263-3ea4-40e0-b542-eea37ff27244 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:26.962899 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-47716263-3ea4-40e0-b542-eea37ff27244 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:26.968982 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-47716263-3ea4-40e0-b542-eea37ff27244 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:26.969499 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-47716263-3ea4-40e0-b542-eea37ff27244 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:26.969920 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-47716263-3ea4-40e0-b542-eea37ff27244 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:26.970660 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-47716263-3ea4-40e0-b542-eea37ff27244 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:26.971158 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-47716263-3ea4-40e0-b542-eea37ff27244 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:26.971598 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-47716263-3ea4-40e0-b542-eea37ff27244 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:27.016462 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-dba42fd8-d86e-42f1-bd9b-f575031c45ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:27.017427 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-dba42fd8-d86e-42f1-bd9b-f575031c45ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:27.024231 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dba42fd8-d86e-42f1-bd9b-f575031c45ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:27.025353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dba42fd8-d86e-42f1-bd9b-f575031c45ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:27.025974 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dba42fd8-d86e-42f1-bd9b-f575031c45ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:27.026886 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dba42fd8-d86e-42f1-bd9b-f575031c45ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:27.027535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dba42fd8-d86e-42f1-bd9b-f575031c45ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:27.028185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dba42fd8-d86e-42f1-bd9b-f575031c45ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:27.140295 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-47716263-3ea4-40e0-b542-eea37ff27244 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:27.151516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-47716263-3ea4-40e0-b542-eea37ff27244 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.193261 Sep 06 16:16:27.152174 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 47/95] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:26 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:27.213320 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-dba42fd8-d86e-42f1-bd9b-f575031c45ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:27.224693 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-dba42fd8-d86e-42f1-bd9b-f575031c45ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.213362 Sep 06 16:16:27.226027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 49/96] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:27 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:27.396582 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e534b160-e66f-4b01-a252-0a91df85b6a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:27.397950 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e534b160-e66f-4b01-a252-0a91df85b6a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:27.404163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e534b160-e66f-4b01-a252-0a91df85b6a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:27.405123 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e534b160-e66f-4b01-a252-0a91df85b6a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:27.405720 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e534b160-e66f-4b01-a252-0a91df85b6a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:27.406639 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e534b160-e66f-4b01-a252-0a91df85b6a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:27.407096 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e534b160-e66f-4b01-a252-0a91df85b6a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:27.407743 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e534b160-e66f-4b01-a252-0a91df85b6a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:27.479707 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e534b160-e66f-4b01-a252-0a91df85b6a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:27.487618 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e534b160-e66f-4b01-a252-0a91df85b6a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.095875 Sep 06 16:16:27.488161 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 48/97] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:27 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:27.576346 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8e1fbeaa-9e46-42c7-ad9f-4dd460c4ae3b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:27.577082 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8e1fbeaa-9e46-42c7-ad9f-4dd460c4ae3b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:27.583672 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e1fbeaa-9e46-42c7-ad9f-4dd460c4ae3b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:27.584144 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e1fbeaa-9e46-42c7-ad9f-4dd460c4ae3b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:27.584738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e1fbeaa-9e46-42c7-ad9f-4dd460c4ae3b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:27.585456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e1fbeaa-9e46-42c7-ad9f-4dd460c4ae3b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:27.586086 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e1fbeaa-9e46-42c7-ad9f-4dd460c4ae3b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:27.586506 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e1fbeaa-9e46-42c7-ad9f-4dd460c4ae3b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:27.655531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8e1fbeaa-9e46-42c7-ad9f-4dd460c4ae3b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:27.664486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8e1fbeaa-9e46-42c7-ad9f-4dd460c4ae3b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:27.665983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8e1fbeaa-9e46-42c7-ad9f-4dd460c4ae3b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:27.667174 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8e1fbeaa-9e46-42c7-ad9f-4dd460c4ae3b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.095273 Sep 06 16:16:27.667761 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 50/98] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:27 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:16:28.178215 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-90f6c449-cc8c-4a65-b993-2cfbc9fd4c4e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:28.178963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-90f6c449-cc8c-4a65-b993-2cfbc9fd4c4e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:28.185590 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90f6c449-cc8c-4a65-b993-2cfbc9fd4c4e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:28.186090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90f6c449-cc8c-4a65-b993-2cfbc9fd4c4e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:28.186536 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90f6c449-cc8c-4a65-b993-2cfbc9fd4c4e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:28.187235 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90f6c449-cc8c-4a65-b993-2cfbc9fd4c4e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:28.187684 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90f6c449-cc8c-4a65-b993-2cfbc9fd4c4e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:28.188583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90f6c449-cc8c-4a65-b993-2cfbc9fd4c4e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:28.211970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:28.270597 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5f49fa8d-3b4a-4fd8-b1c4-ab2d7c73c667 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:28.270597 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5f49fa8d-3b4a-4fd8-b1c4-ab2d7c73c667 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:28.270597 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5f49fa8d-3b4a-4fd8-b1c4-ab2d7c73c667 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:28.270597 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5f49fa8d-3b4a-4fd8-b1c4-ab2d7c73c667 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:28.270944 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5f49fa8d-3b4a-4fd8-b1c4-ab2d7c73c667 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:28.270944 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5f49fa8d-3b4a-4fd8-b1c4-ab2d7c73c667 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:28.270944 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5f49fa8d-3b4a-4fd8-b1c4-ab2d7c73c667 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:28.270944 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5f49fa8d-3b4a-4fd8-b1c4-ab2d7c73c667 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:28.418587 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5f49fa8d-3b4a-4fd8-b1c4-ab2d7c73c667 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:28.428132 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5f49fa8d-3b4a-4fd8-b1c4-ab2d7c73c667 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.177378 Sep 06 16:16:28.429519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 51/99] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:28 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:28.437649 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-90f6c449-cc8c-4a65-b993-2cfbc9fd4c4e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:28.451972 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-90f6c449-cc8c-4a65-b993-2cfbc9fd4c4e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.277748 Sep 06 16:16:28.453199 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 49/100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:28 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:28.511450 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fa2ba6a0-1832-4ce3-ae40-a10e1132c7ed tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:28.512051 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fa2ba6a0-1832-4ce3-ae40-a10e1132c7ed tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:28.518188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fa2ba6a0-1832-4ce3-ae40-a10e1132c7ed tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:28.519086 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fa2ba6a0-1832-4ce3-ae40-a10e1132c7ed tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:28.519248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fa2ba6a0-1832-4ce3-ae40-a10e1132c7ed tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:28.519967 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fa2ba6a0-1832-4ce3-ae40-a10e1132c7ed tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:28.520427 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fa2ba6a0-1832-4ce3-ae40-a10e1132c7ed tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:28.520877 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fa2ba6a0-1832-4ce3-ae40-a10e1132c7ed tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:28.588283 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fa2ba6a0-1832-4ce3-ae40-a10e1132c7ed tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:28.596765 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fa2ba6a0-1832-4ce3-ae40-a10e1132c7ed tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1282 microversion: 2.1 time: 0.089302 Sep 06 16:16:28.597440 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 52/101] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:28 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:28.695713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d4bea105-4b6f-4269-ada5-66d1353bc9a8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:28.696265 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d4bea105-4b6f-4269-ada5-66d1353bc9a8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:28.702463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4bea105-4b6f-4269-ada5-66d1353bc9a8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:28.702955 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4bea105-4b6f-4269-ada5-66d1353bc9a8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:28.703382 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4bea105-4b6f-4269-ada5-66d1353bc9a8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:28.704065 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4bea105-4b6f-4269-ada5-66d1353bc9a8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:28.704523 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4bea105-4b6f-4269-ada5-66d1353bc9a8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:28.704975 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4bea105-4b6f-4269-ada5-66d1353bc9a8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:28.783009 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d4bea105-4b6f-4269-ada5-66d1353bc9a8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:28.803711 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d4bea105-4b6f-4269-ada5-66d1353bc9a8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:28.809149 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d4bea105-4b6f-4269-ada5-66d1353bc9a8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:28.814154 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d4bea105-4b6f-4269-ada5-66d1353bc9a8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1339 microversion: 2.20 time: 0.121935 Sep 06 16:16:28.829774 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 50/102] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:28 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1339 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:29.453246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8ff9e49f-64cd-4fcc-816d-7dc14477201a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:29.454163 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8ff9e49f-64cd-4fcc-816d-7dc14477201a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:29.466518 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8ff9e49f-64cd-4fcc-816d-7dc14477201a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:29.467005 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8ff9e49f-64cd-4fcc-816d-7dc14477201a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:29.467537 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8ff9e49f-64cd-4fcc-816d-7dc14477201a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:29.468505 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8ff9e49f-64cd-4fcc-816d-7dc14477201a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:29.469042 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8ff9e49f-64cd-4fcc-816d-7dc14477201a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:29.469710 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8ff9e49f-64cd-4fcc-816d-7dc14477201a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:29.479320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-96b7ad8d-89cd-466a-99e3-17c17d263a28 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:29.480690 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-96b7ad8d-89cd-466a-99e3-17c17d263a28 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:29.494199 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96b7ad8d-89cd-466a-99e3-17c17d263a28 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:29.497912 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96b7ad8d-89cd-466a-99e3-17c17d263a28 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:29.498678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96b7ad8d-89cd-466a-99e3-17c17d263a28 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:29.501557 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:29.502383 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96b7ad8d-89cd-466a-99e3-17c17d263a28 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:29.505081 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96b7ad8d-89cd-466a-99e3-17c17d263a28 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:29.507165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96b7ad8d-89cd-466a-99e3-17c17d263a28 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:29.915625 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-96b7ad8d-89cd-466a-99e3-17c17d263a28 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:29.937436 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-96b7ad8d-89cd-466a-99e3-17c17d263a28 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.462520 Sep 06 16:16:29.942069 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 51/103] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:29 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:29.957083 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b198bf61-5b37-4ce8-be83-ec601948c166 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:29.960360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b198bf61-5b37-4ce8-be83-ec601948c166 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:29.977051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b198bf61-5b37-4ce8-be83-ec601948c166 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:29.977552 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b198bf61-5b37-4ce8-be83-ec601948c166 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:29.977984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b198bf61-5b37-4ce8-be83-ec601948c166 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:29.978698 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b198bf61-5b37-4ce8-be83-ec601948c166 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:29.979179 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b198bf61-5b37-4ce8-be83-ec601948c166 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:29.981616 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b198bf61-5b37-4ce8-be83-ec601948c166 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:30.091508 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b198bf61-5b37-4ce8-be83-ec601948c166 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:30.103437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b198bf61-5b37-4ce8-be83-ec601948c166 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1280 microversion: 2.1 time: 0.158729 Sep 06 16:16:30.112340 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 52/104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:29 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1280 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:30.126822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9932c3b8-ccc0-4c7a-987f-3238a656c0b6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:30.128348 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9932c3b8-ccc0-4c7a-987f-3238a656c0b6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:30.138823 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9932c3b8-ccc0-4c7a-987f-3238a656c0b6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:30.139705 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9932c3b8-ccc0-4c7a-987f-3238a656c0b6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:30.140933 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9932c3b8-ccc0-4c7a-987f-3238a656c0b6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:30.142420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9932c3b8-ccc0-4c7a-987f-3238a656c0b6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:30.143297 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9932c3b8-ccc0-4c7a-987f-3238a656c0b6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:30.144349 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9932c3b8-ccc0-4c7a-987f-3238a656c0b6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:30.394387 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8ff9e49f-64cd-4fcc-816d-7dc14477201a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:30.405875 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8ff9e49f-64cd-4fcc-816d-7dc14477201a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.957685 Sep 06 16:16:30.423871 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 53/105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:29 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:30.443330 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9932c3b8-ccc0-4c7a-987f-3238a656c0b6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:30.458324 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9932c3b8-ccc0-4c7a-987f-3238a656c0b6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:30.463777 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9932c3b8-ccc0-4c7a-987f-3238a656c0b6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:30.465405 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9932c3b8-ccc0-4c7a-987f-3238a656c0b6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.347365 Sep 06 16:16:30.466482 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 53/106] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:30 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:30.903311 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-5f5e7215-4ee2-422a-93ad-eb7d0daffbe8 req-db212137-8816-497c-a589-3600130cb16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2", "tag": "4b0a3d0f-c85a-40a8-b906-23e0735edd5e"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:30.921436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5f5e7215-4ee2-422a-93ad-eb7d0daffbe8 req-db212137-8816-497c-a589-3600130cb16f service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:30.921919 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5f5e7215-4ee2-422a-93ad-eb7d0daffbe8 req-db212137-8816-497c-a589-3600130cb16f service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:30.922682 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5f5e7215-4ee2-422a-93ad-eb7d0daffbe8 req-db212137-8816-497c-a589-3600130cb16f service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:30.948484 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-5f5e7215-4ee2-422a-93ad-eb7d0daffbe8 req-db212137-8816-497c-a589-3600130cb16f service nova] Creating event network-changed:4b0a3d0f-c85a-40a8-b906-23e0735edd5e for instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 on hv-cinder-85221 Sep 06 16:16:30.949324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5f5e7215-4ee2-422a-93ad-eb7d0daffbe8 req-db212137-8816-497c-a589-3600130cb16f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120669) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 16:16:30.949720 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5f5e7215-4ee2-422a-93ad-eb7d0daffbe8 req-db212137-8816-497c-a589-3600130cb16f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120669) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 16:16:30.950812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64f915ba-1537-4776-8568-cb71a6019fc2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:30.951287 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64f915ba-1537-4776-8568-cb71a6019fc2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:30.951648 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64f915ba-1537-4776-8568-cb71a6019fc2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:30.952367 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64f915ba-1537-4776-8568-cb71a6019fc2 None None] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:30.952841 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64f915ba-1537-4776-8568-cb71a6019fc2 None None] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:30.953264 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64f915ba-1537-4776-8568-cb71a6019fc2 None None] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:30.969464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.compute.rpcapi [None req-64f915ba-1537-4776-8568-cb71a6019fc2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 16:16:30.971007 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-64f915ba-1537-4776-8568-cb71a6019fc2 None None] Releasing lock "compute-rpcapi-router" {{(pid=120669) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 16:16:30.974420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fc175964-18c4-42b4-922e-42361d3c645a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:30.976300 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fc175964-18c4-42b4-922e-42361d3c645a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:30.995356 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-64f915ba-1537-4776-8568-cb71a6019fc2 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183395 Sep 06 16:16:30.996569 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 54/107] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:16:30.999654 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fc175964-18c4-42b4-922e-42361d3c645a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:31.000354 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fc175964-18c4-42b4-922e-42361d3c645a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:31.001012 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fc175964-18c4-42b4-922e-42361d3c645a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:31.002528 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fc175964-18c4-42b4-922e-42361d3c645a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:31.003287 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fc175964-18c4-42b4-922e-42361d3c645a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:31.004367 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fc175964-18c4-42b4-922e-42361d3c645a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:31.135627 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-bb74aeed-c556-4110-b152-9e35e47ca2c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:31.137618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-bb74aeed-c556-4110-b152-9e35e47ca2c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:31.154455 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bb74aeed-c556-4110-b152-9e35e47ca2c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:31.158096 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bb74aeed-c556-4110-b152-9e35e47ca2c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:31.159284 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bb74aeed-c556-4110-b152-9e35e47ca2c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:31.160474 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bb74aeed-c556-4110-b152-9e35e47ca2c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:31.161188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bb74aeed-c556-4110-b152-9e35e47ca2c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:31.161863 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bb74aeed-c556-4110-b152-9e35e47ca2c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:31.346127 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fc175964-18c4-42b4-922e-42361d3c645a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:31.358709 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fc175964-18c4-42b4-922e-42361d3c645a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.398345 Sep 06 16:16:31.359297 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 54/108] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:30 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:31.430859 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-407d87b8-465f-4a86-864c-522a12b82495 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:31.431137 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-407d87b8-465f-4a86-864c-522a12b82495 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:31.443027 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-407d87b8-465f-4a86-864c-522a12b82495 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:31.444211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-407d87b8-465f-4a86-864c-522a12b82495 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:31.445034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-407d87b8-465f-4a86-864c-522a12b82495 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:31.445933 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-407d87b8-465f-4a86-864c-522a12b82495 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:31.446565 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-407d87b8-465f-4a86-864c-522a12b82495 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:31.449603 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-407d87b8-465f-4a86-864c-522a12b82495 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:31.525042 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-bb74aeed-c556-4110-b152-9e35e47ca2c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:31.536942 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-bb74aeed-c556-4110-b152-9e35e47ca2c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.407649 Sep 06 16:16:31.537920 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 55/109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:31 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:31.544419 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3c774acc-33c1-4eaf-a557-af22041a65c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:31.545327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-3c774acc-33c1-4eaf-a557-af22041a65c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:31.552159 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c774acc-33c1-4eaf-a557-af22041a65c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:31.552842 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c774acc-33c1-4eaf-a557-af22041a65c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:31.553473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c774acc-33c1-4eaf-a557-af22041a65c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:31.554442 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c774acc-33c1-4eaf-a557-af22041a65c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:31.555081 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c774acc-33c1-4eaf-a557-af22041a65c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:31.555503 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c774acc-33c1-4eaf-a557-af22041a65c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:31.732655 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-407d87b8-465f-4a86-864c-522a12b82495 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:31.744998 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-407d87b8-465f-4a86-864c-522a12b82495 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.317339 Sep 06 16:16:31.745598 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 55/110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:31 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:31.803138 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3c774acc-33c1-4eaf-a557-af22041a65c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:31.815065 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3c774acc-33c1-4eaf-a557-af22041a65c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:31.817070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3c774acc-33c1-4eaf-a557-af22041a65c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:31.818738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-3c774acc-33c1-4eaf-a557-af22041a65c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.279699 Sep 06 16:16:31.819617 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 56/111] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:31 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:31.855881 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-a25be7f5-d475-4604-a7a3-cf10cba87ca6 req-8a0099c6-f4c9-4443-afa8-7b9b64786fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc140df-902e-4875-822f-53831e91b1c3", "tag": "42ae6570-50c2-4446-95be-d0b723ac181e"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:31.872429 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a25be7f5-d475-4604-a7a3-cf10cba87ca6 req-8a0099c6-f4c9-4443-afa8-7b9b64786fc2 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:31.872971 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a25be7f5-d475-4604-a7a3-cf10cba87ca6 req-8a0099c6-f4c9-4443-afa8-7b9b64786fc2 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:31.873397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a25be7f5-d475-4604-a7a3-cf10cba87ca6 req-8a0099c6-f4c9-4443-afa8-7b9b64786fc2 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:31.894301 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-a25be7f5-d475-4604-a7a3-cf10cba87ca6 req-8a0099c6-f4c9-4443-afa8-7b9b64786fc2 service nova] Creating event network-changed:42ae6570-50c2-4446-95be-d0b723ac181e for instance dbc140df-902e-4875-822f-53831e91b1c3 on hv-cinder-85221 Sep 06 16:16:31.894818 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a25be7f5-d475-4604-a7a3-cf10cba87ca6 req-8a0099c6-f4c9-4443-afa8-7b9b64786fc2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120668) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 16:16:31.895203 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a25be7f5-d475-4604-a7a3-cf10cba87ca6 req-8a0099c6-f4c9-4443-afa8-7b9b64786fc2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120668) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 16:16:31.896228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-af0116d8-88de-4a4f-bce9-7cff50eda5ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:31.896678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-af0116d8-88de-4a4f-bce9-7cff50eda5ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:31.897221 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-af0116d8-88de-4a4f-bce9-7cff50eda5ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:31.897951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-af0116d8-88de-4a4f-bce9-7cff50eda5ba None None] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:31.898391 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-af0116d8-88de-4a4f-bce9-7cff50eda5ba None None] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:31.898798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-af0116d8-88de-4a4f-bce9-7cff50eda5ba None None] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:31.908965 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.compute.rpcapi [None req-af0116d8-88de-4a4f-bce9-7cff50eda5ba None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 16:16:31.908965 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-af0116d8-88de-4a4f-bce9-7cff50eda5ba None None] Releasing lock "compute-rpcapi-router" {{(pid=120668) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 16:16:31.924599 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-af0116d8-88de-4a4f-bce9-7cff50eda5ba None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135708 Sep 06 16:16:31.925268 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 56/112] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:16:32.395529 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-37ab563d-1ec8-4bd6-9bc1-bf79a41671c8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:32.397039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-37ab563d-1ec8-4bd6-9bc1-bf79a41671c8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:32.404146 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-37ab563d-1ec8-4bd6-9bc1-bf79a41671c8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:32.405046 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-37ab563d-1ec8-4bd6-9bc1-bf79a41671c8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:32.405741 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-37ab563d-1ec8-4bd6-9bc1-bf79a41671c8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:32.406850 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-37ab563d-1ec8-4bd6-9bc1-bf79a41671c8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:32.407508 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-37ab563d-1ec8-4bd6-9bc1-bf79a41671c8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:32.408359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-37ab563d-1ec8-4bd6-9bc1-bf79a41671c8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:32.553884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-37ab563d-1ec8-4bd6-9bc1-bf79a41671c8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:32.562105 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-37ab563d-1ec8-4bd6-9bc1-bf79a41671c8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.181277 Sep 06 16:16:32.562272 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-39f12f3c-1345-49af-bfc4-42136f13c880 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:32.562708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 57/113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:32 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:32.566355 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-39f12f3c-1345-49af-bfc4-42136f13c880 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:32.573231 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39f12f3c-1345-49af-bfc4-42136f13c880 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:32.573891 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39f12f3c-1345-49af-bfc4-42136f13c880 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:32.574722 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39f12f3c-1345-49af-bfc4-42136f13c880 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:32.575587 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39f12f3c-1345-49af-bfc4-42136f13c880 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:32.576127 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39f12f3c-1345-49af-bfc4-42136f13c880 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:32.576727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39f12f3c-1345-49af-bfc4-42136f13c880 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:32.709121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-39f12f3c-1345-49af-bfc4-42136f13c880 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:32.717087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-39f12f3c-1345-49af-bfc4-42136f13c880 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.159278 Sep 06 16:16:32.717658 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 57/114] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:32 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:32.778691 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a024b6cc-01c1-44b3-b4a9-a325401bd269 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:32.779363 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a024b6cc-01c1-44b3-b4a9-a325401bd269 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:32.786205 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a024b6cc-01c1-44b3-b4a9-a325401bd269 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:32.786687 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a024b6cc-01c1-44b3-b4a9-a325401bd269 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:32.787112 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a024b6cc-01c1-44b3-b4a9-a325401bd269 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:32.787801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a024b6cc-01c1-44b3-b4a9-a325401bd269 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:32.788242 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a024b6cc-01c1-44b3-b4a9-a325401bd269 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:32.788655 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a024b6cc-01c1-44b3-b4a9-a325401bd269 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:32.845835 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ac47c421-14a9-4c02-89be-b0218a01ba18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:32.846439 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ac47c421-14a9-4c02-89be-b0218a01ba18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:32.852611 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ac47c421-14a9-4c02-89be-b0218a01ba18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:32.853150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ac47c421-14a9-4c02-89be-b0218a01ba18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:32.854393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ac47c421-14a9-4c02-89be-b0218a01ba18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:32.855289 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ac47c421-14a9-4c02-89be-b0218a01ba18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:32.855739 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ac47c421-14a9-4c02-89be-b0218a01ba18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:32.856157 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ac47c421-14a9-4c02-89be-b0218a01ba18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:32.930956 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a024b6cc-01c1-44b3-b4a9-a325401bd269 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:32.942143 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a024b6cc-01c1-44b3-b4a9-a325401bd269 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.167754 Sep 06 16:16:32.946354 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 58/115] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:32 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:33.020700 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-d728413c-f71c-4440-bb79-dc646ffee327 req-f319caf5-b9e4-4939-b915-304953e8dd14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d1b8c7-0e2d-4897-9945-2c9b6dec52a9", "tag": "f0247727-02b0-4655-ace0-070a17630877"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:33.031807 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-d728413c-f71c-4440-bb79-dc646ffee327 req-f319caf5-b9e4-4939-b915-304953e8dd14 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:33.032451 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-d728413c-f71c-4440-bb79-dc646ffee327 req-f319caf5-b9e4-4939-b915-304953e8dd14 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:33.033085 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-d728413c-f71c-4440-bb79-dc646ffee327 req-f319caf5-b9e4-4939-b915-304953e8dd14 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:33.034237 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ac47c421-14a9-4c02-89be-b0218a01ba18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:33.044797 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ac47c421-14a9-4c02-89be-b0218a01ba18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:33.046808 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ac47c421-14a9-4c02-89be-b0218a01ba18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:33.047202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-d728413c-f71c-4440-bb79-dc646ffee327 req-f319caf5-b9e4-4939-b915-304953e8dd14 service nova] Creating event network-changed:f0247727-02b0-4655-ace0-070a17630877 for instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 on hv-cinder-85221 Sep 06 16:16:33.047723 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ac47c421-14a9-4c02-89be-b0218a01ba18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.205919 Sep 06 16:16:33.049263 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 58/116] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:32 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:16:33.071207 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-d728413c-f71c-4440-bb79-dc646ffee327 req-f319caf5-b9e4-4939-b915-304953e8dd14 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054039 Sep 06 16:16:33.071824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 59/117] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:16:33.585817 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-912858d7-c346-4955-8bbc-a90cf2b107ea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:33.586467 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-912858d7-c346-4955-8bbc-a90cf2b107ea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:33.593055 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-912858d7-c346-4955-8bbc-a90cf2b107ea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:33.593548 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-912858d7-c346-4955-8bbc-a90cf2b107ea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:33.593982 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-912858d7-c346-4955-8bbc-a90cf2b107ea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:33.594690 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-912858d7-c346-4955-8bbc-a90cf2b107ea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:33.595144 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-912858d7-c346-4955-8bbc-a90cf2b107ea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:33.595585 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-912858d7-c346-4955-8bbc-a90cf2b107ea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:33.740919 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3837d1ad-ad9c-43e4-8f90-c7fa6d7e961d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:33.741636 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-3837d1ad-ad9c-43e4-8f90-c7fa6d7e961d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:33.743377 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-912858d7-c346-4955-8bbc-a90cf2b107ea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:33.748102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3837d1ad-ad9c-43e4-8f90-c7fa6d7e961d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:33.748598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3837d1ad-ad9c-43e4-8f90-c7fa6d7e961d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:33.749056 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3837d1ad-ad9c-43e4-8f90-c7fa6d7e961d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:33.749755 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3837d1ad-ad9c-43e4-8f90-c7fa6d7e961d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:33.750206 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3837d1ad-ad9c-43e4-8f90-c7fa6d7e961d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:33.750625 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3837d1ad-ad9c-43e4-8f90-c7fa6d7e961d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:33.751566 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-912858d7-c346-4955-8bbc-a90cf2b107ea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.169763 Sep 06 16:16:33.752164 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 59/118] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:33 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:33.893601 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3837d1ad-ad9c-43e4-8f90-c7fa6d7e961d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:33.901496 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-3837d1ad-ad9c-43e4-8f90-c7fa6d7e961d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.164815 Sep 06 16:16:33.902065 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 60/119] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:33 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:33.954406 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-eb7cb8e4-63d7-41e2-85e5-fb6e1185ce2f req-3fac75be-3fc2-4926-bddb-157cac523af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7a8803-c332-4dde-baee-ec2049243bf4", "tag": "c6993609-38ee-4cc3-b97f-75c88fcd8888"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:33.964864 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-eb7cb8e4-63d7-41e2-85e5-fb6e1185ce2f req-3fac75be-3fc2-4926-bddb-157cac523af4 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:33.965338 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-eb7cb8e4-63d7-41e2-85e5-fb6e1185ce2f req-3fac75be-3fc2-4926-bddb-157cac523af4 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:33.965768 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-eb7cb8e4-63d7-41e2-85e5-fb6e1185ce2f req-3fac75be-3fc2-4926-bddb-157cac523af4 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:33.971916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-664243e6-71aa-4f58-a319-f927b7df7280 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:33.973238 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-664243e6-71aa-4f58-a319-f927b7df7280 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:33.978668 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-eb7cb8e4-63d7-41e2-85e5-fb6e1185ce2f req-3fac75be-3fc2-4926-bddb-157cac523af4 service nova] Creating event network-changed:c6993609-38ee-4cc3-b97f-75c88fcd8888 for instance af7a8803-c332-4dde-baee-ec2049243bf4 on hv-cinder-85221 Sep 06 16:16:33.983531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-664243e6-71aa-4f58-a319-f927b7df7280 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:33.983826 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-eb7cb8e4-63d7-41e2-85e5-fb6e1185ce2f req-3fac75be-3fc2-4926-bddb-157cac523af4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033221 Sep 06 16:16:33.984549 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-664243e6-71aa-4f58-a319-f927b7df7280 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:33.985089 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 60/120] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:16:33.985520 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-664243e6-71aa-4f58-a319-f927b7df7280 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:33.986240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-664243e6-71aa-4f58-a319-f927b7df7280 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:33.986688 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-664243e6-71aa-4f58-a319-f927b7df7280 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:33.987257 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-664243e6-71aa-4f58-a319-f927b7df7280 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:34.077730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-35bdb635-b706-4a70-9a10-6ab79bf69ad3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:34.078519 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-35bdb635-b706-4a70-9a10-6ab79bf69ad3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:34.085341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35bdb635-b706-4a70-9a10-6ab79bf69ad3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:34.086508 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35bdb635-b706-4a70-9a10-6ab79bf69ad3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:34.087056 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35bdb635-b706-4a70-9a10-6ab79bf69ad3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:34.087852 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35bdb635-b706-4a70-9a10-6ab79bf69ad3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:34.088461 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35bdb635-b706-4a70-9a10-6ab79bf69ad3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:34.089134 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35bdb635-b706-4a70-9a10-6ab79bf69ad3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:34.685084 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-35bdb635-b706-4a70-9a10-6ab79bf69ad3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:34.700881 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-35bdb635-b706-4a70-9a10-6ab79bf69ad3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:34.705990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-35bdb635-b706-4a70-9a10-6ab79bf69ad3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:34.708038 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-35bdb635-b706-4a70-9a10-6ab79bf69ad3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.635132 Sep 06 16:16:34.726090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 61/121] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:34 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:16:34.733260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-664243e6-71aa-4f58-a319-f927b7df7280 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:34.741033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-664243e6-71aa-4f58-a319-f927b7df7280 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.775857 Sep 06 16:16:34.745754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 61/122] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:33 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:34.779344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c313b7a5-1363-4e96-95d7-0f557da4efdf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:34.780011 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c313b7a5-1363-4e96-95d7-0f557da4efdf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:34.790502 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c313b7a5-1363-4e96-95d7-0f557da4efdf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:34.791248 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c313b7a5-1363-4e96-95d7-0f557da4efdf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:34.792555 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c313b7a5-1363-4e96-95d7-0f557da4efdf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:34.794255 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c313b7a5-1363-4e96-95d7-0f557da4efdf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:34.795506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c313b7a5-1363-4e96-95d7-0f557da4efdf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:34.796678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c313b7a5-1363-4e96-95d7-0f557da4efdf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:34.926815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8f6a2152-8dc1-4fb8-843e-939cdd182af8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:34.927406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8f6a2152-8dc1-4fb8-843e-939cdd182af8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:34.944494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f6a2152-8dc1-4fb8-843e-939cdd182af8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:34.945185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f6a2152-8dc1-4fb8-843e-939cdd182af8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:34.945920 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f6a2152-8dc1-4fb8-843e-939cdd182af8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:34.946792 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f6a2152-8dc1-4fb8-843e-939cdd182af8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:34.947231 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f6a2152-8dc1-4fb8-843e-939cdd182af8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:34.947819 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f6a2152-8dc1-4fb8-843e-939cdd182af8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:35.178999 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c313b7a5-1363-4e96-95d7-0f557da4efdf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:35.188684 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c313b7a5-1363-4e96-95d7-0f557da4efdf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.414280 Sep 06 16:16:35.189283 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 62/123] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:34 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:35.421374 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8f6a2152-8dc1-4fb8-843e-939cdd182af8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:35.430909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8f6a2152-8dc1-4fb8-843e-939cdd182af8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.508015 Sep 06 16:16:35.431993 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 62/124] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:34 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:35.738704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e62d9226-9249-48d7-8d83-184a967c3587 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:35.739461 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e62d9226-9249-48d7-8d83-184a967c3587 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:35.748555 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e62d9226-9249-48d7-8d83-184a967c3587 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:35.750051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e62d9226-9249-48d7-8d83-184a967c3587 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:35.750502 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e62d9226-9249-48d7-8d83-184a967c3587 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:35.751770 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e62d9226-9249-48d7-8d83-184a967c3587 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:35.752231 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e62d9226-9249-48d7-8d83-184a967c3587 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:35.752650 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e62d9226-9249-48d7-8d83-184a967c3587 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:35.771663 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-99714bbd-7cb4-46c0-80d4-4ee17e4c9389 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:35.772421 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-99714bbd-7cb4-46c0-80d4-4ee17e4c9389 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:35.791418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99714bbd-7cb4-46c0-80d4-4ee17e4c9389 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:35.792182 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99714bbd-7cb4-46c0-80d4-4ee17e4c9389 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:35.793557 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99714bbd-7cb4-46c0-80d4-4ee17e4c9389 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:35.796861 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99714bbd-7cb4-46c0-80d4-4ee17e4c9389 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:35.798802 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99714bbd-7cb4-46c0-80d4-4ee17e4c9389 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:35.800049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99714bbd-7cb4-46c0-80d4-4ee17e4c9389 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:36.201864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-99714bbd-7cb4-46c0-80d4-4ee17e4c9389 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:36.214585 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-99714bbd-7cb4-46c0-80d4-4ee17e4c9389 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.447284 Sep 06 16:16:36.215193 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 63/125] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:35 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:36.245936 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e81eca05-9932-4f33-b2e3-fd1c1b1b0165 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:36.246868 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e81eca05-9932-4f33-b2e3-fd1c1b1b0165 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:36.254194 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e81eca05-9932-4f33-b2e3-fd1c1b1b0165 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:36.254945 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e81eca05-9932-4f33-b2e3-fd1c1b1b0165 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:36.255595 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e81eca05-9932-4f33-b2e3-fd1c1b1b0165 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:36.256855 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e81eca05-9932-4f33-b2e3-fd1c1b1b0165 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:36.257736 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e81eca05-9932-4f33-b2e3-fd1c1b1b0165 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:36.258796 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e81eca05-9932-4f33-b2e3-fd1c1b1b0165 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:36.323375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e62d9226-9249-48d7-8d83-184a967c3587 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:36.333948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e62d9226-9249-48d7-8d83-184a967c3587 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:36.338100 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e62d9226-9249-48d7-8d83-184a967c3587 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:36.342937 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e62d9226-9249-48d7-8d83-184a967c3587 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.605345 Sep 06 16:16:36.343732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 63/126] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:35 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:36.438513 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-7798263a-648f-4515-8fd4-aa41974652ed req-8c206111-a913-4fef-853f-1e17508bf25f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0088f479-7a4c-4bf2-909d-f7caf1795be8", "tag": "9b788b0b-0011-463e-88c6-ea88f1a5652f"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:36.452076 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-7798263a-648f-4515-8fd4-aa41974652ed req-8c206111-a913-4fef-853f-1e17508bf25f service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:36.453700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-7798263a-648f-4515-8fd4-aa41974652ed req-8c206111-a913-4fef-853f-1e17508bf25f service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:36.454120 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-7798263a-648f-4515-8fd4-aa41974652ed req-8c206111-a913-4fef-853f-1e17508bf25f service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:36.470678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-7798263a-648f-4515-8fd4-aa41974652ed req-8c206111-a913-4fef-853f-1e17508bf25f service nova] Creating event network-changed:9b788b0b-0011-463e-88c6-ea88f1a5652f for instance 0088f479-7a4c-4bf2-909d-f7caf1795be8 on hv-cinder-85221 Sep 06 16:16:36.477068 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-7798263a-648f-4515-8fd4-aa41974652ed req-8c206111-a913-4fef-853f-1e17508bf25f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044427 Sep 06 16:16:36.478240 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 64/127] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:16:36.483888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b003252d-280f-48dc-ad7e-c7fdf13ec9a9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:36.484581 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b003252d-280f-48dc-ad7e-c7fdf13ec9a9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:36.494423 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b003252d-280f-48dc-ad7e-c7fdf13ec9a9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:36.495504 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b003252d-280f-48dc-ad7e-c7fdf13ec9a9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:36.496641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b003252d-280f-48dc-ad7e-c7fdf13ec9a9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:36.498001 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b003252d-280f-48dc-ad7e-c7fdf13ec9a9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:36.498756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b003252d-280f-48dc-ad7e-c7fdf13ec9a9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:36.499518 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b003252d-280f-48dc-ad7e-c7fdf13ec9a9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:36.526114 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e81eca05-9932-4f33-b2e3-fd1c1b1b0165 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:36.537155 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e81eca05-9932-4f33-b2e3-fd1c1b1b0165 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.308695 Sep 06 16:16:36.538356 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 64/128] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:36 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:36.697667 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b003252d-280f-48dc-ad7e-c7fdf13ec9a9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:36.706214 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b003252d-280f-48dc-ad7e-c7fdf13ec9a9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.226615 Sep 06 16:16:36.706901 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 65/129] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:36 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:37.252196 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-13a53473-d9f3-4fc6-a76f-f3d600786982 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:37.252892 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-13a53473-d9f3-4fc6-a76f-f3d600786982 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:37.259558 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-13a53473-d9f3-4fc6-a76f-f3d600786982 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.260049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-13a53473-d9f3-4fc6-a76f-f3d600786982 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.260486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-13a53473-d9f3-4fc6-a76f-f3d600786982 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.261223 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-13a53473-d9f3-4fc6-a76f-f3d600786982 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.261693 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-13a53473-d9f3-4fc6-a76f-f3d600786982 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.262118 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-13a53473-d9f3-4fc6-a76f-f3d600786982 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.374805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0c00dc77-12ac-436a-ba0f-e816a3d3eddc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:37.375415 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0c00dc77-12ac-436a-ba0f-e816a3d3eddc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:37.381769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0c00dc77-12ac-436a-ba0f-e816a3d3eddc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.382245 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0c00dc77-12ac-436a-ba0f-e816a3d3eddc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.382667 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0c00dc77-12ac-436a-ba0f-e816a3d3eddc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.383410 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0c00dc77-12ac-436a-ba0f-e816a3d3eddc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.383853 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0c00dc77-12ac-436a-ba0f-e816a3d3eddc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.384307 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0c00dc77-12ac-436a-ba0f-e816a3d3eddc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.520796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0c00dc77-12ac-436a-ba0f-e816a3d3eddc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:37.529482 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0c00dc77-12ac-436a-ba0f-e816a3d3eddc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:37.530899 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0c00dc77-12ac-436a-ba0f-e816a3d3eddc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:37.531994 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0c00dc77-12ac-436a-ba0f-e816a3d3eddc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.161353 Sep 06 16:16:37.532513 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 66/130] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:37 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:16:37.577543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-13a53473-d9f3-4fc6-a76f-f3d600786982 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:37.584340 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a5e43516-0b20-475a-957f-8aea4f3035e0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:37.585078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a5e43516-0b20-475a-957f-8aea4f3035e0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:37.586883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-13a53473-d9f3-4fc6-a76f-f3d600786982 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.338949 Sep 06 16:16:37.587490 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 65/131] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:37 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:37.592566 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5e43516-0b20-475a-957f-8aea4f3035e0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.593117 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5e43516-0b20-475a-957f-8aea4f3035e0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.593518 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5e43516-0b20-475a-957f-8aea4f3035e0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.594232 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5e43516-0b20-475a-957f-8aea4f3035e0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.594679 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5e43516-0b20-475a-957f-8aea4f3035e0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.595157 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5e43516-0b20-475a-957f-8aea4f3035e0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.733896 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a5e43516-0b20-475a-957f-8aea4f3035e0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:37.734565 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7938f4b5-28be-4214-811b-e883df1842c4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:37.735172 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7938f4b5-28be-4214-811b-e883df1842c4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:37.737397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:37.741537 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7938f4b5-28be-4214-811b-e883df1842c4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.743615 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7938f4b5-28be-4214-811b-e883df1842c4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.743763 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a5e43516-0b20-475a-957f-8aea4f3035e0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.162579 Sep 06 16:16:37.743847 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7938f4b5-28be-4214-811b-e883df1842c4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.743847 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7938f4b5-28be-4214-811b-e883df1842c4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.743981 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 67/132] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:37 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:37.744048 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7938f4b5-28be-4214-811b-e883df1842c4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.744048 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7938f4b5-28be-4214-811b-e883df1842c4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.878077 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7938f4b5-28be-4214-811b-e883df1842c4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:37.886514 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7938f4b5-28be-4214-811b-e883df1842c4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.155728 Sep 06 16:16:37.887071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 66/133] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:37 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:38.557615 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-aaf37ff7-c1fb-4a2e-8f89-b40cf172ed1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:38.558171 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-aaf37ff7-c1fb-4a2e-8f89-b40cf172ed1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:38.565256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-aaf37ff7-c1fb-4a2e-8f89-b40cf172ed1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:38.565730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-aaf37ff7-c1fb-4a2e-8f89-b40cf172ed1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:38.566151 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-aaf37ff7-c1fb-4a2e-8f89-b40cf172ed1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:38.566825 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-aaf37ff7-c1fb-4a2e-8f89-b40cf172ed1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:38.567267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-aaf37ff7-c1fb-4a2e-8f89-b40cf172ed1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:38.567677 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-aaf37ff7-c1fb-4a2e-8f89-b40cf172ed1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:38.609938 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-84d72bf1-6f52-489e-9014-7d00ce0d88c3 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:38.610541 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-84d72bf1-6f52-489e-9014-7d00ce0d88c3 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:38.617065 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-84d72bf1-6f52-489e-9014-7d00ce0d88c3 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:38.617543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-84d72bf1-6f52-489e-9014-7d00ce0d88c3 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:38.617968 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-84d72bf1-6f52-489e-9014-7d00ce0d88c3 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:38.618655 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-84d72bf1-6f52-489e-9014-7d00ce0d88c3 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:38.619099 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-84d72bf1-6f52-489e-9014-7d00ce0d88c3 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:38.619510 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-84d72bf1-6f52-489e-9014-7d00ce0d88c3 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:38.704439 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-aaf37ff7-c1fb-4a2e-8f89-b40cf172ed1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:38.712867 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-aaf37ff7-c1fb-4a2e-8f89-b40cf172ed1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:38.714507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-aaf37ff7-c1fb-4a2e-8f89-b40cf172ed1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:38.716108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-aaf37ff7-c1fb-4a2e-8f89-b40cf172ed1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.162468 Sep 06 16:16:38.716672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 68/134] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:38 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:38.756132 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-84d72bf1-6f52-489e-9014-7d00ce0d88c3 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:38.764092 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-84d72bf1-6f52-489e-9014-7d00ce0d88c3 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.157979 Sep 06 16:16:38.764849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 67/135] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:38 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:38.765058 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-eec286b1-dec5-484c-93a5-89f1504cb8fc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:38.765737 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-eec286b1-dec5-484c-93a5-89f1504cb8fc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:38.771872 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eec286b1-dec5-484c-93a5-89f1504cb8fc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:38.772352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eec286b1-dec5-484c-93a5-89f1504cb8fc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:38.772820 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eec286b1-dec5-484c-93a5-89f1504cb8fc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:38.773570 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eec286b1-dec5-484c-93a5-89f1504cb8fc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:38.774020 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eec286b1-dec5-484c-93a5-89f1504cb8fc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:38.774437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eec286b1-dec5-484c-93a5-89f1504cb8fc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:38.906046 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-eec286b1-dec5-484c-93a5-89f1504cb8fc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:38.909666 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a1aa5a44-8e51-41bc-86e3-0642c8b666e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:38.910311 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a1aa5a44-8e51-41bc-86e3-0642c8b666e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:38.914325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-eec286b1-dec5-484c-93a5-89f1504cb8fc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.153079 Sep 06 16:16:38.914909 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 69/136] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:38 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:38.916675 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a1aa5a44-8e51-41bc-86e3-0642c8b666e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:38.917223 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a1aa5a44-8e51-41bc-86e3-0642c8b666e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:38.917647 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a1aa5a44-8e51-41bc-86e3-0642c8b666e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:38.918338 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a1aa5a44-8e51-41bc-86e3-0642c8b666e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:38.918935 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a1aa5a44-8e51-41bc-86e3-0642c8b666e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:38.919354 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a1aa5a44-8e51-41bc-86e3-0642c8b666e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:39.047208 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a1aa5a44-8e51-41bc-86e3-0642c8b666e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:39.055151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a1aa5a44-8e51-41bc-86e3-0642c8b666e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.149282 Sep 06 16:16:39.055740 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 68/137] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:38 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:39.741519 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b7a294ac-1b1d-44e4-a728-681eb195379f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:39.742115 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b7a294ac-1b1d-44e4-a728-681eb195379f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:39.749988 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b7a294ac-1b1d-44e4-a728-681eb195379f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:39.750504 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b7a294ac-1b1d-44e4-a728-681eb195379f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:39.750960 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b7a294ac-1b1d-44e4-a728-681eb195379f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:39.751686 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b7a294ac-1b1d-44e4-a728-681eb195379f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:39.752130 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b7a294ac-1b1d-44e4-a728-681eb195379f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:39.752548 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b7a294ac-1b1d-44e4-a728-681eb195379f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:39.788348 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-93b52826-6897-4bee-979f-ae406927a109 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:39.789824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-93b52826-6897-4bee-979f-ae406927a109 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:39.796507 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-93b52826-6897-4bee-979f-ae406927a109 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:39.797028 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-93b52826-6897-4bee-979f-ae406927a109 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:39.797458 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-93b52826-6897-4bee-979f-ae406927a109 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:39.798171 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-93b52826-6897-4bee-979f-ae406927a109 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:39.798626 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-93b52826-6897-4bee-979f-ae406927a109 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:39.799040 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-93b52826-6897-4bee-979f-ae406927a109 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:39.898157 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b7a294ac-1b1d-44e4-a728-681eb195379f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:39.906513 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b7a294ac-1b1d-44e4-a728-681eb195379f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:39.907923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b7a294ac-1b1d-44e4-a728-681eb195379f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:39.909049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b7a294ac-1b1d-44e4-a728-681eb195379f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.172100 Sep 06 16:16:39.910062 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 70/138] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:39 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:39.939154 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-62667897-7ec7-42c3-ae8c-62db11c6780b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:39.940533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-62667897-7ec7-42c3-ae8c-62db11c6780b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:39.940708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-93b52826-6897-4bee-979f-ae406927a109 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:39.946831 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62667897-7ec7-42c3-ae8c-62db11c6780b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:39.947325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62667897-7ec7-42c3-ae8c-62db11c6780b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:39.947747 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62667897-7ec7-42c3-ae8c-62db11c6780b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:39.948191 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-93b52826-6897-4bee-979f-ae406927a109 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.164491 Sep 06 16:16:39.948435 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62667897-7ec7-42c3-ae8c-62db11c6780b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:39.948801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 69/139] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:39 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:39.948929 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62667897-7ec7-42c3-ae8c-62db11c6780b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:39.949471 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62667897-7ec7-42c3-ae8c-62db11c6780b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:40.078507 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c7606546-af5e-48e7-a897-047cb6675188 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:40.079193 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c7606546-af5e-48e7-a897-047cb6675188 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:40.085698 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c7606546-af5e-48e7-a897-047cb6675188 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:40.085824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c7606546-af5e-48e7-a897-047cb6675188 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:40.086249 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c7606546-af5e-48e7-a897-047cb6675188 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:40.086938 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c7606546-af5e-48e7-a897-047cb6675188 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:40.087066 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-62667897-7ec7-42c3-ae8c-62db11c6780b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:40.087522 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c7606546-af5e-48e7-a897-047cb6675188 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:40.087948 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c7606546-af5e-48e7-a897-047cb6675188 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:40.095002 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-62667897-7ec7-42c3-ae8c-62db11c6780b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.161430 Sep 06 16:16:40.095621 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 71/140] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:39 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:40.218397 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c7606546-af5e-48e7-a897-047cb6675188 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:40.222279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:40.227264 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c7606546-af5e-48e7-a897-047cb6675188 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.152899 Sep 06 16:16:40.227855 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 70/141] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:40 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:40.934149 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0e4cc1e5-39d5-40a3-a4ca-53dc4f97a937 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:40.934716 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0e4cc1e5-39d5-40a3-a4ca-53dc4f97a937 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:40.941598 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0e4cc1e5-39d5-40a3-a4ca-53dc4f97a937 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:40.942070 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0e4cc1e5-39d5-40a3-a4ca-53dc4f97a937 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:40.942494 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0e4cc1e5-39d5-40a3-a4ca-53dc4f97a937 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:40.943171 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0e4cc1e5-39d5-40a3-a4ca-53dc4f97a937 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:40.943617 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0e4cc1e5-39d5-40a3-a4ca-53dc4f97a937 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:40.944034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0e4cc1e5-39d5-40a3-a4ca-53dc4f97a937 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:40.972208 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-66a2f9c0-c144-4b02-ab24-f5890328bf8b tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:40.972849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-66a2f9c0-c144-4b02-ab24-f5890328bf8b tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:40.975035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:40.981165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-66a2f9c0-c144-4b02-ab24-f5890328bf8b tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:40.981651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-66a2f9c0-c144-4b02-ab24-f5890328bf8b tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:40.982085 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-66a2f9c0-c144-4b02-ab24-f5890328bf8b tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:40.982788 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-66a2f9c0-c144-4b02-ab24-f5890328bf8b tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:40.983242 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-66a2f9c0-c144-4b02-ab24-f5890328bf8b tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:40.983662 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-66a2f9c0-c144-4b02-ab24-f5890328bf8b tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:41.083485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0e4cc1e5-39d5-40a3-a4ca-53dc4f97a937 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:41.092225 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0e4cc1e5-39d5-40a3-a4ca-53dc4f97a937 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:41.093735 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0e4cc1e5-39d5-40a3-a4ca-53dc4f97a937 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:41.094883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0e4cc1e5-39d5-40a3-a4ca-53dc4f97a937 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.164720 Sep 06 16:16:41.095451 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 72/142] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:40 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:41.118332 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-40b64319-a84a-495a-b33c-1af67c037861 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:41.118686 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-66a2f9c0-c144-4b02-ab24-f5890328bf8b tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:41.118936 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-40b64319-a84a-495a-b33c-1af67c037861 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:41.125448 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-40b64319-a84a-495a-b33c-1af67c037861 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:41.125860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-40b64319-a84a-495a-b33c-1af67c037861 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:41.126287 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-40b64319-a84a-495a-b33c-1af67c037861 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:41.126661 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-66a2f9c0-c144-4b02-ab24-f5890328bf8b tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.158710 Sep 06 16:16:41.126969 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-40b64319-a84a-495a-b33c-1af67c037861 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:41.127260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 71/143] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:40 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:41.127434 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-40b64319-a84a-495a-b33c-1af67c037861 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:41.127837 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-40b64319-a84a-495a-b33c-1af67c037861 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:41.251699 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c1e3691c-fa7e-4e96-b94b-3df19ea2b0f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:41.252613 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c1e3691c-fa7e-4e96-b94b-3df19ea2b0f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:41.259394 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c1e3691c-fa7e-4e96-b94b-3df19ea2b0f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:41.259934 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c1e3691c-fa7e-4e96-b94b-3df19ea2b0f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:41.260357 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c1e3691c-fa7e-4e96-b94b-3df19ea2b0f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:41.261031 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-40b64319-a84a-495a-b33c-1af67c037861 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:41.261157 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c1e3691c-fa7e-4e96-b94b-3df19ea2b0f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:41.261627 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c1e3691c-fa7e-4e96-b94b-3df19ea2b0f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:41.262116 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c1e3691c-fa7e-4e96-b94b-3df19ea2b0f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:41.269169 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-40b64319-a84a-495a-b33c-1af67c037861 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.154759 Sep 06 16:16:41.269756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 73/144] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:41 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:41.400069 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c1e3691c-fa7e-4e96-b94b-3df19ea2b0f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:41.408190 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c1e3691c-fa7e-4e96-b94b-3df19ea2b0f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.161492 Sep 06 16:16:41.408781 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 72/145] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:41 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:42.119892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d7cd26ea-0e65-463f-8222-1cb9f578e839 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:42.120522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d7cd26ea-0e65-463f-8222-1cb9f578e839 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:42.122442 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:42.127848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7cd26ea-0e65-463f-8222-1cb9f578e839 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:42.128358 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7cd26ea-0e65-463f-8222-1cb9f578e839 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:42.128799 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7cd26ea-0e65-463f-8222-1cb9f578e839 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:42.129478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7cd26ea-0e65-463f-8222-1cb9f578e839 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:42.129937 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7cd26ea-0e65-463f-8222-1cb9f578e839 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:42.130343 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7cd26ea-0e65-463f-8222-1cb9f578e839 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:42.150678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d3b84e16-b2dd-4c42-b687-5d24cd2186a5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:42.151473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d3b84e16-b2dd-4c42-b687-5d24cd2186a5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:42.157906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d3b84e16-b2dd-4c42-b687-5d24cd2186a5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:42.158440 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d3b84e16-b2dd-4c42-b687-5d24cd2186a5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:42.159087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d3b84e16-b2dd-4c42-b687-5d24cd2186a5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:42.160018 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d3b84e16-b2dd-4c42-b687-5d24cd2186a5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:42.160633 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d3b84e16-b2dd-4c42-b687-5d24cd2186a5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:42.161485 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d3b84e16-b2dd-4c42-b687-5d24cd2186a5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:42.297061 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d7cd26ea-0e65-463f-8222-1cb9f578e839 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:42.306422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d7cd26ea-0e65-463f-8222-1cb9f578e839 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:42.307933 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d7cd26ea-0e65-463f-8222-1cb9f578e839 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:42.309673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d7cd26ea-0e65-463f-8222-1cb9f578e839 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.193652 Sep 06 16:16:42.310250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 74/146] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:42 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:42.312310 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d3b84e16-b2dd-4c42-b687-5d24cd2186a5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:42.321223 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d3b84e16-b2dd-4c42-b687-5d24cd2186a5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.174514 Sep 06 16:16:42.321813 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 73/147] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:42 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:42.326441 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f5499ea7-6bcd-4508-97ef-e3d261d60a5d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:42.327187 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f5499ea7-6bcd-4508-97ef-e3d261d60a5d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:42.334580 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5499ea7-6bcd-4508-97ef-e3d261d60a5d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:42.335319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5499ea7-6bcd-4508-97ef-e3d261d60a5d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:42.335907 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5499ea7-6bcd-4508-97ef-e3d261d60a5d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:42.336768 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5499ea7-6bcd-4508-97ef-e3d261d60a5d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:42.341373 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5499ea7-6bcd-4508-97ef-e3d261d60a5d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:42.341819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5499ea7-6bcd-4508-97ef-e3d261d60a5d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:42.430884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-85201dce-0980-4eda-947c-710e11c2f12c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:42.431494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-85201dce-0980-4eda-947c-710e11c2f12c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:42.438131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85201dce-0980-4eda-947c-710e11c2f12c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:42.438619 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85201dce-0980-4eda-947c-710e11c2f12c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:42.439049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85201dce-0980-4eda-947c-710e11c2f12c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:42.439963 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85201dce-0980-4eda-947c-710e11c2f12c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:42.440413 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85201dce-0980-4eda-947c-710e11c2f12c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:42.441104 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85201dce-0980-4eda-947c-710e11c2f12c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:42.481209 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f5499ea7-6bcd-4508-97ef-e3d261d60a5d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:42.489378 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f5499ea7-6bcd-4508-97ef-e3d261d60a5d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.166708 Sep 06 16:16:42.489991 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 75/148] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:42 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:42.572919 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-85201dce-0980-4eda-947c-710e11c2f12c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:42.580745 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-85201dce-0980-4eda-947c-710e11c2f12c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.153890 Sep 06 16:16:42.581337 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 74/149] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:42 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:43.335714 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-10cf99bb-d634-4804-af8b-15709e927c2c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:43.336306 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-10cf99bb-d634-4804-af8b-15709e927c2c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:43.342501 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10cf99bb-d634-4804-af8b-15709e927c2c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.342973 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10cf99bb-d634-4804-af8b-15709e927c2c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.343384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10cf99bb-d634-4804-af8b-15709e927c2c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.343537 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f453f73d-1e0c-4947-a614-3b1a5d1241e2 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:43.344057 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10cf99bb-d634-4804-af8b-15709e927c2c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.344193 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f453f73d-1e0c-4947-a614-3b1a5d1241e2 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:43.344519 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10cf99bb-d634-4804-af8b-15709e927c2c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.344960 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10cf99bb-d634-4804-af8b-15709e927c2c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.355258 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f453f73d-1e0c-4947-a614-3b1a5d1241e2 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.356258 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f453f73d-1e0c-4947-a614-3b1a5d1241e2 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.357001 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f453f73d-1e0c-4947-a614-3b1a5d1241e2 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.357995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f453f73d-1e0c-4947-a614-3b1a5d1241e2 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.358667 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f453f73d-1e0c-4947-a614-3b1a5d1241e2 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.359221 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f453f73d-1e0c-4947-a614-3b1a5d1241e2 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.481588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-10cf99bb-d634-4804-af8b-15709e927c2c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:43.490249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-10cf99bb-d634-4804-af8b-15709e927c2c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:43.491677 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-10cf99bb-d634-4804-af8b-15709e927c2c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:43.492796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-10cf99bb-d634-4804-af8b-15709e927c2c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.161114 Sep 06 16:16:43.493376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 76/150] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:43 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:43.501505 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f453f73d-1e0c-4947-a614-3b1a5d1241e2 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:43.509975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f453f73d-1e0c-4947-a614-3b1a5d1241e2 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.170377 Sep 06 16:16:43.510721 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 75/151] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:43 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:43.512457 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-60de98e9-3aed-49f6-8fc7-7fafd6bdb6a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:43.513109 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-60de98e9-3aed-49f6-8fc7-7fafd6bdb6a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:43.519507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60de98e9-3aed-49f6-8fc7-7fafd6bdb6a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.520068 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60de98e9-3aed-49f6-8fc7-7fafd6bdb6a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.520406 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60de98e9-3aed-49f6-8fc7-7fafd6bdb6a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.521251 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60de98e9-3aed-49f6-8fc7-7fafd6bdb6a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.521736 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60de98e9-3aed-49f6-8fc7-7fafd6bdb6a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.522149 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60de98e9-3aed-49f6-8fc7-7fafd6bdb6a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.603993 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-232c2a77-8658-45e9-9057-ac752dd007e8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:43.604579 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-232c2a77-8658-45e9-9057-ac752dd007e8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:43.611116 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-232c2a77-8658-45e9-9057-ac752dd007e8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.611712 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-232c2a77-8658-45e9-9057-ac752dd007e8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.612205 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-232c2a77-8658-45e9-9057-ac752dd007e8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.613035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-232c2a77-8658-45e9-9057-ac752dd007e8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.613549 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-232c2a77-8658-45e9-9057-ac752dd007e8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.614089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-232c2a77-8658-45e9-9057-ac752dd007e8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.656917 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-60de98e9-3aed-49f6-8fc7-7fafd6bdb6a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:43.666324 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-60de98e9-3aed-49f6-8fc7-7fafd6bdb6a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.158476 Sep 06 16:16:43.666906 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 77/152] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:43 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:43.750032 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-232c2a77-8658-45e9-9057-ac752dd007e8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:43.758403 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-232c2a77-8658-45e9-9057-ac752dd007e8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.158635 Sep 06 16:16:43.758980 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 76/153] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:43 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:44.518359 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-85aa7cd0-fa19-496e-a24b-53a1526d14c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:44.518967 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-85aa7cd0-fa19-496e-a24b-53a1526d14c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:44.525782 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85aa7cd0-fa19-496e-a24b-53a1526d14c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.526386 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85aa7cd0-fa19-496e-a24b-53a1526d14c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.526800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85aa7cd0-fa19-496e-a24b-53a1526d14c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.527555 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85aa7cd0-fa19-496e-a24b-53a1526d14c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.528052 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85aa7cd0-fa19-496e-a24b-53a1526d14c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.528465 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85aa7cd0-fa19-496e-a24b-53a1526d14c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.534150 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-31a03e6e-68ea-4dac-8272-d487dea89188 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:44.534996 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-31a03e6e-68ea-4dac-8272-d487dea89188 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:44.541622 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31a03e6e-68ea-4dac-8272-d487dea89188 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.542161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31a03e6e-68ea-4dac-8272-d487dea89188 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.542669 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31a03e6e-68ea-4dac-8272-d487dea89188 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.543353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31a03e6e-68ea-4dac-8272-d487dea89188 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.543794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31a03e6e-68ea-4dac-8272-d487dea89188 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.544204 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31a03e6e-68ea-4dac-8272-d487dea89188 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.665134 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-85aa7cd0-fa19-496e-a24b-53a1526d14c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:44.674039 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-85aa7cd0-fa19-496e-a24b-53a1526d14c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:44.675562 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-85aa7cd0-fa19-496e-a24b-53a1526d14c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:44.676844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-85aa7cd0-fa19-496e-a24b-53a1526d14c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.162516 Sep 06 16:16:44.677485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 78/154] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:44 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:44.679450 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-31a03e6e-68ea-4dac-8272-d487dea89188 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:44.687198 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-31a03e6e-68ea-4dac-8272-d487dea89188 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.157993 Sep 06 16:16:44.688416 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 77/155] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:44 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:44.689810 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d559b71d-c84e-4383-aca9-d2f48c0e7bef tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:44.690523 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d559b71d-c84e-4383-aca9-d2f48c0e7bef tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:44.694524 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:44.698689 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d559b71d-c84e-4383-aca9-d2f48c0e7bef tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.699202 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d559b71d-c84e-4383-aca9-d2f48c0e7bef tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.699634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d559b71d-c84e-4383-aca9-d2f48c0e7bef tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.700353 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d559b71d-c84e-4383-aca9-d2f48c0e7bef tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.700819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d559b71d-c84e-4383-aca9-d2f48c0e7bef tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.701407 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d559b71d-c84e-4383-aca9-d2f48c0e7bef tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.781893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9a9eac52-f908-41d3-92b1-9efc8a6d296c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:44.782500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9a9eac52-f908-41d3-92b1-9efc8a6d296c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:44.788728 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a9eac52-f908-41d3-92b1-9efc8a6d296c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.789231 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a9eac52-f908-41d3-92b1-9efc8a6d296c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.789652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a9eac52-f908-41d3-92b1-9efc8a6d296c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.790334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a9eac52-f908-41d3-92b1-9efc8a6d296c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.790803 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a9eac52-f908-41d3-92b1-9efc8a6d296c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.791213 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a9eac52-f908-41d3-92b1-9efc8a6d296c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.845114 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d559b71d-c84e-4383-aca9-d2f48c0e7bef tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:44.853321 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d559b71d-c84e-4383-aca9-d2f48c0e7bef tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.168407 Sep 06 16:16:44.853920 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 79/156] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:44 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:44.919813 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9a9eac52-f908-41d3-92b1-9efc8a6d296c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:44.927656 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9a9eac52-f908-41d3-92b1-9efc8a6d296c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.149843 Sep 06 16:16:44.928285 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 78/157] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:44 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:45.702740 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7e839779-0da4-4a55-b41e-0797f63df238 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:45.703611 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7e839779-0da4-4a55-b41e-0797f63df238 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:45.709993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7e839779-0da4-4a55-b41e-0797f63df238 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:45.710546 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7e839779-0da4-4a55-b41e-0797f63df238 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:45.711035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7e839779-0da4-4a55-b41e-0797f63df238 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:45.711776 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7e839779-0da4-4a55-b41e-0797f63df238 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:45.711937 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0d679f0b-d6ec-477f-9770-44a11f919bfb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:45.712399 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7e839779-0da4-4a55-b41e-0797f63df238 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:45.712836 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7e839779-0da4-4a55-b41e-0797f63df238 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:45.713331 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0d679f0b-d6ec-477f-9770-44a11f919bfb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:45.719535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d679f0b-d6ec-477f-9770-44a11f919bfb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:45.720011 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d679f0b-d6ec-477f-9770-44a11f919bfb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:45.720426 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d679f0b-d6ec-477f-9770-44a11f919bfb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:45.721408 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d679f0b-d6ec-477f-9770-44a11f919bfb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:45.721891 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d679f0b-d6ec-477f-9770-44a11f919bfb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:45.722312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d679f0b-d6ec-477f-9770-44a11f919bfb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:45.864723 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7e839779-0da4-4a55-b41e-0797f63df238 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:45.870273 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0d679f0b-d6ec-477f-9770-44a11f919bfb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:45.873315 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7e839779-0da4-4a55-b41e-0797f63df238 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:45.874713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7e839779-0da4-4a55-b41e-0797f63df238 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:45.875797 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7e839779-0da4-4a55-b41e-0797f63df238 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.177022 Sep 06 16:16:45.876389 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 80/158] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:45 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:45.880976 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9329a368-bcac-470c-a49e-74363bb41317 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:45.881541 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9329a368-bcac-470c-a49e-74363bb41317 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:45.884446 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0d679f0b-d6ec-477f-9770-44a11f919bfb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.176547 Sep 06 16:16:45.885149 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 79/159] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:45 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:45.887766 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9329a368-bcac-470c-a49e-74363bb41317 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:45.888247 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9329a368-bcac-470c-a49e-74363bb41317 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:45.888673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9329a368-bcac-470c-a49e-74363bb41317 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:45.889565 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9329a368-bcac-470c-a49e-74363bb41317 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:45.890016 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9329a368-bcac-470c-a49e-74363bb41317 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:45.890431 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9329a368-bcac-470c-a49e-74363bb41317 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:45.951429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a64056c2-8fe4-4d90-941e-62c908bc3821 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:45.952151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a64056c2-8fe4-4d90-941e-62c908bc3821 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:45.958364 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a64056c2-8fe4-4d90-941e-62c908bc3821 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:45.958853 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a64056c2-8fe4-4d90-941e-62c908bc3821 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:45.959290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a64056c2-8fe4-4d90-941e-62c908bc3821 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:45.960008 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a64056c2-8fe4-4d90-941e-62c908bc3821 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:45.960449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a64056c2-8fe4-4d90-941e-62c908bc3821 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:45.960886 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a64056c2-8fe4-4d90-941e-62c908bc3821 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:46.023449 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9329a368-bcac-470c-a49e-74363bb41317 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:46.031411 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9329a368-bcac-470c-a49e-74363bb41317 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.153962 Sep 06 16:16:46.031992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 81/160] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:45 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:46.092264 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a64056c2-8fe4-4d90-941e-62c908bc3821 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:46.100576 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a64056c2-8fe4-4d90-941e-62c908bc3821 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.153149 Sep 06 16:16:46.101183 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 80/161] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:45 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:46.901653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4617648a-44d3-4656-9c48-da1c56aad32e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:46.902265 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4617648a-44d3-4656-9c48-da1c56aad32e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:46.907563 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-2fef2c6f-2e6f-4d2c-8c47-c4f1546450ce tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:46.908122 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-2fef2c6f-2e6f-4d2c-8c47-c4f1546450ce tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:46.909363 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4617648a-44d3-4656-9c48-da1c56aad32e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:46.909863 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4617648a-44d3-4656-9c48-da1c56aad32e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:46.910303 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4617648a-44d3-4656-9c48-da1c56aad32e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:46.911012 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4617648a-44d3-4656-9c48-da1c56aad32e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:46.912182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4617648a-44d3-4656-9c48-da1c56aad32e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:46.912610 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4617648a-44d3-4656-9c48-da1c56aad32e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:46.914786 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2fef2c6f-2e6f-4d2c-8c47-c4f1546450ce tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:46.915301 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2fef2c6f-2e6f-4d2c-8c47-c4f1546450ce tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:46.915718 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2fef2c6f-2e6f-4d2c-8c47-c4f1546450ce tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:46.916428 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2fef2c6f-2e6f-4d2c-8c47-c4f1546450ce tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:46.916915 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2fef2c6f-2e6f-4d2c-8c47-c4f1546450ce tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:46.917353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2fef2c6f-2e6f-4d2c-8c47-c4f1546450ce tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:47.054092 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-2fef2c6f-2e6f-4d2c-8c47-c4f1546450ce tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:47.055833 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4617648a-44d3-4656-9c48-da1c56aad32e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:47.064605 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-2fef2c6f-2e6f-4d2c-8c47-c4f1546450ce tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.160361 Sep 06 16:16:47.065226 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4617648a-44d3-4656-9c48-da1c56aad32e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:47.065351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 81/162] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:46 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:47.070809 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4ff5faee-148d-4229-862c-30f62c89b5cc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:47.071417 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4ff5faee-148d-4229-862c-30f62c89b5cc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:47.075101 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4617648a-44d3-4656-9c48-da1c56aad32e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:47.076283 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4617648a-44d3-4656-9c48-da1c56aad32e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.178605 Sep 06 16:16:47.076874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 82/163] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:46 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:47.078407 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ff5faee-148d-4229-862c-30f62c89b5cc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:47.078907 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ff5faee-148d-4229-862c-30f62c89b5cc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:47.079425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ff5faee-148d-4229-862c-30f62c89b5cc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:47.080141 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ff5faee-148d-4229-862c-30f62c89b5cc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:47.080591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ff5faee-148d-4229-862c-30f62c89b5cc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:47.081040 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ff5faee-148d-4229-862c-30f62c89b5cc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:47.123481 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5abbf99f-322d-405f-b043-eab176586171 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:47.124116 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5abbf99f-322d-405f-b043-eab176586171 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:47.130421 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5abbf99f-322d-405f-b043-eab176586171 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:47.130949 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5abbf99f-322d-405f-b043-eab176586171 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:47.131372 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5abbf99f-322d-405f-b043-eab176586171 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:47.132061 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5abbf99f-322d-405f-b043-eab176586171 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:47.132504 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5abbf99f-322d-405f-b043-eab176586171 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:47.132950 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5abbf99f-322d-405f-b043-eab176586171 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:47.226673 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4ff5faee-148d-4229-862c-30f62c89b5cc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:47.250920 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4ff5faee-148d-4229-862c-30f62c89b5cc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.184220 Sep 06 16:16:47.261313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 82/164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:47 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:47.296708 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5abbf99f-322d-405f-b043-eab176586171 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:47.304825 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5abbf99f-322d-405f-b043-eab176586171 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.185072 Sep 06 16:16:47.305437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 83/165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:47 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:48.087763 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4b8be46e-ff5a-485d-9218-9b59212f7f3c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:48.089093 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4b8be46e-ff5a-485d-9218-9b59212f7f3c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:48.096228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b8be46e-ff5a-485d-9218-9b59212f7f3c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:48.097689 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b8be46e-ff5a-485d-9218-9b59212f7f3c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:48.098326 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b8be46e-ff5a-485d-9218-9b59212f7f3c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:48.102361 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-69421b1f-f26d-4950-945e-1668e26bd8c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:48.102966 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b8be46e-ff5a-485d-9218-9b59212f7f3c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:48.103073 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b8be46e-ff5a-485d-9218-9b59212f7f3c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:48.104057 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b8be46e-ff5a-485d-9218-9b59212f7f3c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:48.104433 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-69421b1f-f26d-4950-945e-1668e26bd8c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:48.112738 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-69421b1f-f26d-4950-945e-1668e26bd8c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:48.113969 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-69421b1f-f26d-4950-945e-1668e26bd8c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:48.114629 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-69421b1f-f26d-4950-945e-1668e26bd8c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:48.115540 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-69421b1f-f26d-4950-945e-1668e26bd8c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:48.116203 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-69421b1f-f26d-4950-945e-1668e26bd8c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:48.116848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-69421b1f-f26d-4950-945e-1668e26bd8c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:48.138886 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:48.277817 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4b8be46e-ff5a-485d-9218-9b59212f7f3c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:48.282888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-69421b1f-f26d-4950-945e-1668e26bd8c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:48.288121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4b8be46e-ff5a-485d-9218-9b59212f7f3c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.204244 Sep 06 16:16:48.295875 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-69421b1f-f26d-4950-945e-1668e26bd8c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:48.298660 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-69421b1f-f26d-4950-945e-1668e26bd8c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:48.301418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 83/166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:48 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:48.305765 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-69421b1f-f26d-4950-945e-1668e26bd8c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.207294 Sep 06 16:16:48.306983 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 84/167] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:48 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:48.310052 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e7c6a425-929e-4191-beee-b0c70651d736 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:48.310729 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e7c6a425-929e-4191-beee-b0c70651d736 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:48.317463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c6a425-929e-4191-beee-b0c70651d736 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:48.317949 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c6a425-929e-4191-beee-b0c70651d736 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:48.318478 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c6a425-929e-4191-beee-b0c70651d736 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:48.319227 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c6a425-929e-4191-beee-b0c70651d736 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:48.319679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c6a425-929e-4191-beee-b0c70651d736 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:48.320094 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c6a425-929e-4191-beee-b0c70651d736 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:48.331807 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fbfe8918-a6ad-46e7-9f31-551539f06b9d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:48.338031 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fbfe8918-a6ad-46e7-9f31-551539f06b9d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:48.356352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fbfe8918-a6ad-46e7-9f31-551539f06b9d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:48.357145 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fbfe8918-a6ad-46e7-9f31-551539f06b9d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:48.358202 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fbfe8918-a6ad-46e7-9f31-551539f06b9d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:48.359451 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fbfe8918-a6ad-46e7-9f31-551539f06b9d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:48.360248 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fbfe8918-a6ad-46e7-9f31-551539f06b9d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:48.361292 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fbfe8918-a6ad-46e7-9f31-551539f06b9d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:48.491352 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e7c6a425-929e-4191-beee-b0c70651d736 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:48.500986 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e7c6a425-929e-4191-beee-b0c70651d736 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.198373 Sep 06 16:16:48.501606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 84/168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:48 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:48.503575 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fbfe8918-a6ad-46e7-9f31-551539f06b9d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:48.513220 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fbfe8918-a6ad-46e7-9f31-551539f06b9d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.188695 Sep 06 16:16:48.513868 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 85/169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:48 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:49.314656 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-16c193ed-f8e8-48ff-8d6f-87b260e4bb6e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:49.315216 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-16c193ed-f8e8-48ff-8d6f-87b260e4bb6e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:49.321637 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-16c193ed-f8e8-48ff-8d6f-87b260e4bb6e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:49.322120 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-16c193ed-f8e8-48ff-8d6f-87b260e4bb6e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:49.322546 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-16c193ed-f8e8-48ff-8d6f-87b260e4bb6e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.323240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-16c193ed-f8e8-48ff-8d6f-87b260e4bb6e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:49.323679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-16c193ed-f8e8-48ff-8d6f-87b260e4bb6e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:49.324117 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-16c193ed-f8e8-48ff-8d6f-87b260e4bb6e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.335663 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0288986d-4085-451d-86c3-38c147e9350b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:49.336222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0288986d-4085-451d-86c3-38c147e9350b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:49.342596 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0288986d-4085-451d-86c3-38c147e9350b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:49.343087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0288986d-4085-451d-86c3-38c147e9350b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:49.343504 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0288986d-4085-451d-86c3-38c147e9350b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.344184 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0288986d-4085-451d-86c3-38c147e9350b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:49.344660 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0288986d-4085-451d-86c3-38c147e9350b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:49.345084 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0288986d-4085-451d-86c3-38c147e9350b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.488302 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-16c193ed-f8e8-48ff-8d6f-87b260e4bb6e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:49.496294 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-16c193ed-f8e8-48ff-8d6f-87b260e4bb6e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.185943 Sep 06 16:16:49.497263 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 85/170] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:49 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:49.511613 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0288986d-4085-451d-86c3-38c147e9350b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:49.519704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0288986d-4085-451d-86c3-38c147e9350b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:49.521485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0288986d-4085-451d-86c3-38c147e9350b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:49.522586 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0288986d-4085-451d-86c3-38c147e9350b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.190971 Sep 06 16:16:49.523131 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 86/171] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:49 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:49.526246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6cf535a9-e6eb-4597-a89f-ef30b1bcd982 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:49.526856 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6cf535a9-e6eb-4597-a89f-ef30b1bcd982 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:49.533383 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf535a9-e6eb-4597-a89f-ef30b1bcd982 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:49.533534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf535a9-e6eb-4597-a89f-ef30b1bcd982 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:49.533994 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf535a9-e6eb-4597-a89f-ef30b1bcd982 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.534681 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf535a9-e6eb-4597-a89f-ef30b1bcd982 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:49.535125 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf535a9-e6eb-4597-a89f-ef30b1bcd982 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:49.535550 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf535a9-e6eb-4597-a89f-ef30b1bcd982 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.535908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a222713a-a012-45b4-970f-1dc1a836a684 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:49.536632 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a222713a-a012-45b4-970f-1dc1a836a684 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:49.543121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a222713a-a012-45b4-970f-1dc1a836a684 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:49.543598 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a222713a-a012-45b4-970f-1dc1a836a684 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:49.544018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a222713a-a012-45b4-970f-1dc1a836a684 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.544697 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a222713a-a012-45b4-970f-1dc1a836a684 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:49.545167 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a222713a-a012-45b4-970f-1dc1a836a684 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:49.545566 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a222713a-a012-45b4-970f-1dc1a836a684 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.669565 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6cf535a9-e6eb-4597-a89f-ef30b1bcd982 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:49.677233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a222713a-a012-45b4-970f-1dc1a836a684 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:49.677528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6cf535a9-e6eb-4597-a89f-ef30b1bcd982 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.154847 Sep 06 16:16:49.677851 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 86/172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:49 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:49.685418 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a222713a-a012-45b4-970f-1dc1a836a684 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.154023 Sep 06 16:16:49.686000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 87/173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:49 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:50.519835 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fbbf4c3d-04b1-4bfa-8f95-6c81ddae3da7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:50.520529 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fbbf4c3d-04b1-4bfa-8f95-6c81ddae3da7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:50.527164 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fbbf4c3d-04b1-4bfa-8f95-6c81ddae3da7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.527823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fbbf4c3d-04b1-4bfa-8f95-6c81ddae3da7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.528256 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fbbf4c3d-04b1-4bfa-8f95-6c81ddae3da7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.531368 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fbbf4c3d-04b1-4bfa-8f95-6c81ddae3da7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.531932 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fbbf4c3d-04b1-4bfa-8f95-6c81ddae3da7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.532260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fbbf4c3d-04b1-4bfa-8f95-6c81ddae3da7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.547708 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2e2eb5aa-6271-4b78-a297-c73f466538e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:50.548927 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2e2eb5aa-6271-4b78-a297-c73f466538e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:50.555145 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:50.555444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e2eb5aa-6271-4b78-a297-c73f466538e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.555935 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e2eb5aa-6271-4b78-a297-c73f466538e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.556370 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e2eb5aa-6271-4b78-a297-c73f466538e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.557097 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e2eb5aa-6271-4b78-a297-c73f466538e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.557619 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e2eb5aa-6271-4b78-a297-c73f466538e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.558233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e2eb5aa-6271-4b78-a297-c73f466538e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.670456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fbbf4c3d-04b1-4bfa-8f95-6c81ddae3da7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:50.679128 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fbbf4c3d-04b1-4bfa-8f95-6c81ddae3da7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.163263 Sep 06 16:16:50.679810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 87/174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:50 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:50.699543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c9dd5fff-c1f5-4874-9e31-621a325fd3d2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:50.699693 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2e2eb5aa-6271-4b78-a297-c73f466538e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:50.700299 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c9dd5fff-c1f5-4874-9e31-621a325fd3d2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:50.706596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9dd5fff-c1f5-4874-9e31-621a325fd3d2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.707087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9dd5fff-c1f5-4874-9e31-621a325fd3d2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.707563 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9dd5fff-c1f5-4874-9e31-621a325fd3d2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.708211 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9dd5fff-c1f5-4874-9e31-621a325fd3d2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.708541 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2e2eb5aa-6271-4b78-a297-c73f466538e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:50.708717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9dd5fff-c1f5-4874-9e31-621a325fd3d2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.709180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9dd5fff-c1f5-4874-9e31-621a325fd3d2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.710171 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2e2eb5aa-6271-4b78-a297-c73f466538e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:50.711285 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2e2eb5aa-6271-4b78-a297-c73f466538e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.167755 Sep 06 16:16:50.711842 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 88/175] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:50 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:50.721659 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a5fcaa02-248f-446a-90b9-2ff12adb2bb5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:50.722533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a5fcaa02-248f-446a-90b9-2ff12adb2bb5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:50.728629 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5fcaa02-248f-446a-90b9-2ff12adb2bb5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.729152 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5fcaa02-248f-446a-90b9-2ff12adb2bb5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.729835 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5fcaa02-248f-446a-90b9-2ff12adb2bb5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.730691 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5fcaa02-248f-446a-90b9-2ff12adb2bb5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.731144 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5fcaa02-248f-446a-90b9-2ff12adb2bb5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.731596 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a5fcaa02-248f-446a-90b9-2ff12adb2bb5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.845810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c9dd5fff-c1f5-4874-9e31-621a325fd3d2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:50.853487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c9dd5fff-c1f5-4874-9e31-621a325fd3d2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.157805 Sep 06 16:16:50.854052 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 88/176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:50 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:50.863296 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a5fcaa02-248f-446a-90b9-2ff12adb2bb5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:50.871008 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a5fcaa02-248f-446a-90b9-2ff12adb2bb5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.153182 Sep 06 16:16:50.871558 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 89/177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:50 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:51.702822 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-35968c0c-e97a-43c6-9bbb-4c41f9d8222c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:51.703397 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-35968c0c-e97a-43c6-9bbb-4c41f9d8222c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:51.709984 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35968c0c-e97a-43c6-9bbb-4c41f9d8222c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.710459 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35968c0c-e97a-43c6-9bbb-4c41f9d8222c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.710880 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35968c0c-e97a-43c6-9bbb-4c41f9d8222c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:51.711548 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35968c0c-e97a-43c6-9bbb-4c41f9d8222c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.711985 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35968c0c-e97a-43c6-9bbb-4c41f9d8222c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.712420 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35968c0c-e97a-43c6-9bbb-4c41f9d8222c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:51.735671 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2ce7a0a5-ddfa-47d7-b88e-44ebd167ba04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:51.736344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2ce7a0a5-ddfa-47d7-b88e-44ebd167ba04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:51.742865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2ce7a0a5-ddfa-47d7-b88e-44ebd167ba04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.743347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2ce7a0a5-ddfa-47d7-b88e-44ebd167ba04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.743776 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2ce7a0a5-ddfa-47d7-b88e-44ebd167ba04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:51.744441 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2ce7a0a5-ddfa-47d7-b88e-44ebd167ba04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.744925 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2ce7a0a5-ddfa-47d7-b88e-44ebd167ba04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.745352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2ce7a0a5-ddfa-47d7-b88e-44ebd167ba04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:51.845289 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-35968c0c-e97a-43c6-9bbb-4c41f9d8222c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:51.853384 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-35968c0c-e97a-43c6-9bbb-4c41f9d8222c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.154339 Sep 06 16:16:51.853984 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 89/178] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:51 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:51.877533 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8e589c2b-d21a-4b4c-80f2-8c45cd03eef6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:51.878234 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8e589c2b-d21a-4b4c-80f2-8c45cd03eef6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:51.884039 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2ce7a0a5-ddfa-47d7-b88e-44ebd167ba04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:51.884843 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e589c2b-d21a-4b4c-80f2-8c45cd03eef6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.885338 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e589c2b-d21a-4b4c-80f2-8c45cd03eef6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.885767 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e589c2b-d21a-4b4c-80f2-8c45cd03eef6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:51.886469 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e589c2b-d21a-4b4c-80f2-8c45cd03eef6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.887078 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e589c2b-d21a-4b4c-80f2-8c45cd03eef6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.887674 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e589c2b-d21a-4b4c-80f2-8c45cd03eef6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:51.894492 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2ce7a0a5-ddfa-47d7-b88e-44ebd167ba04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:51.895955 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2ce7a0a5-ddfa-47d7-b88e-44ebd167ba04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:51.897210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2ce7a0a5-ddfa-47d7-b88e-44ebd167ba04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.165442 Sep 06 16:16:51.897917 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 90/179] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:51 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:51.903185 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-73a9193a-2bf0-4bed-bc14-51ea5a61b443 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:51.904266 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-73a9193a-2bf0-4bed-bc14-51ea5a61b443 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:51.910903 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-73a9193a-2bf0-4bed-bc14-51ea5a61b443 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.911397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-73a9193a-2bf0-4bed-bc14-51ea5a61b443 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.912136 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-73a9193a-2bf0-4bed-bc14-51ea5a61b443 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:51.913013 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-73a9193a-2bf0-4bed-bc14-51ea5a61b443 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.913613 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-73a9193a-2bf0-4bed-bc14-51ea5a61b443 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.914185 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-73a9193a-2bf0-4bed-bc14-51ea5a61b443 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:52.023844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8e589c2b-d21a-4b4c-80f2-8c45cd03eef6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:52.031867 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8e589c2b-d21a-4b4c-80f2-8c45cd03eef6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.158769 Sep 06 16:16:52.032445 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 90/180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:51 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:52.049117 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-73a9193a-2bf0-4bed-bc14-51ea5a61b443 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:52.056886 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-73a9193a-2bf0-4bed-bc14-51ea5a61b443 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.157719 Sep 06 16:16:52.057454 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 91/181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:51 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:52.877605 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d81e4926-b4e5-485f-9ccd-847eea76bdbb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:52.878180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d81e4926-b4e5-485f-9ccd-847eea76bdbb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:52.884790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d81e4926-b4e5-485f-9ccd-847eea76bdbb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:52.885293 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d81e4926-b4e5-485f-9ccd-847eea76bdbb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:52.885743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d81e4926-b4e5-485f-9ccd-847eea76bdbb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:52.886443 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d81e4926-b4e5-485f-9ccd-847eea76bdbb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:52.886887 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d81e4926-b4e5-485f-9ccd-847eea76bdbb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:52.887303 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d81e4926-b4e5-485f-9ccd-847eea76bdbb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:52.923821 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-90a61f0f-1fe6-43b6-a464-0923728692e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:52.924441 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-90a61f0f-1fe6-43b6-a464-0923728692e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:52.931178 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90a61f0f-1fe6-43b6-a464-0923728692e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:52.931672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90a61f0f-1fe6-43b6-a464-0923728692e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:52.932113 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90a61f0f-1fe6-43b6-a464-0923728692e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:52.932862 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90a61f0f-1fe6-43b6-a464-0923728692e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:52.933311 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90a61f0f-1fe6-43b6-a464-0923728692e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:52.933733 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90a61f0f-1fe6-43b6-a464-0923728692e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:53.028398 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d81e4926-b4e5-485f-9ccd-847eea76bdbb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:53.036992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d81e4926-b4e5-485f-9ccd-847eea76bdbb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.163078 Sep 06 16:16:53.037584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 91/182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:52 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:53.055572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d96bc1f2-f655-4c78-bc40-d4e589e74eea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:53.056187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d96bc1f2-f655-4c78-bc40-d4e589e74eea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:53.062918 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d96bc1f2-f655-4c78-bc40-d4e589e74eea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:53.063414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d96bc1f2-f655-4c78-bc40-d4e589e74eea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:53.063854 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d96bc1f2-f655-4c78-bc40-d4e589e74eea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:53.064566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d96bc1f2-f655-4c78-bc40-d4e589e74eea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:53.065042 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d96bc1f2-f655-4c78-bc40-d4e589e74eea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:53.065476 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d96bc1f2-f655-4c78-bc40-d4e589e74eea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:53.071152 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-90a61f0f-1fe6-43b6-a464-0923728692e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:53.080130 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-90a61f0f-1fe6-43b6-a464-0923728692e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:53.081822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-90a61f0f-1fe6-43b6-a464-0923728692e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:53.083025 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-90a61f0f-1fe6-43b6-a464-0923728692e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.163224 Sep 06 16:16:53.083715 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 92/183] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:52 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:53.088448 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-bcce62f5-65af-438c-be8d-c1da857ba3c9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:53.089150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-bcce62f5-65af-438c-be8d-c1da857ba3c9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:53.095355 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bcce62f5-65af-438c-be8d-c1da857ba3c9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:53.096526 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bcce62f5-65af-438c-be8d-c1da857ba3c9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:53.097264 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bcce62f5-65af-438c-be8d-c1da857ba3c9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:53.098038 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bcce62f5-65af-438c-be8d-c1da857ba3c9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:53.098549 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bcce62f5-65af-438c-be8d-c1da857ba3c9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:53.099033 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bcce62f5-65af-438c-be8d-c1da857ba3c9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:53.211878 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d96bc1f2-f655-4c78-bc40-d4e589e74eea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:53.222222 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d96bc1f2-f655-4c78-bc40-d4e589e74eea tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.170628 Sep 06 16:16:53.222874 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 92/184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:53 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:53.254545 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-bcce62f5-65af-438c-be8d-c1da857ba3c9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:53.262382 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-bcce62f5-65af-438c-be8d-c1da857ba3c9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.177589 Sep 06 16:16:53.262952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 93/185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:53 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:54.060449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-185dabb6-5c2c-4383-83b7-cafe11a81781 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:54.061198 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-185dabb6-5c2c-4383-83b7-cafe11a81781 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:54.063697 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=99 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:54.069797 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-185dabb6-5c2c-4383-83b7-cafe11a81781 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.070396 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-185dabb6-5c2c-4383-83b7-cafe11a81781 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.070865 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-185dabb6-5c2c-4383-83b7-cafe11a81781 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.071610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-185dabb6-5c2c-4383-83b7-cafe11a81781 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.072220 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-185dabb6-5c2c-4383-83b7-cafe11a81781 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.072577 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-185dabb6-5c2c-4383-83b7-cafe11a81781 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.111858 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ed0febbe-b251-4b2e-8bc8-c69884dd9215 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:54.112445 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ed0febbe-b251-4b2e-8bc8-c69884dd9215 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:54.119125 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed0febbe-b251-4b2e-8bc8-c69884dd9215 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.119598 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed0febbe-b251-4b2e-8bc8-c69884dd9215 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.120009 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed0febbe-b251-4b2e-8bc8-c69884dd9215 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.120721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed0febbe-b251-4b2e-8bc8-c69884dd9215 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.121211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed0febbe-b251-4b2e-8bc8-c69884dd9215 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.121627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed0febbe-b251-4b2e-8bc8-c69884dd9215 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.224000 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-185dabb6-5c2c-4383-83b7-cafe11a81781 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:54.233218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-185dabb6-5c2c-4383-83b7-cafe11a81781 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.176745 Sep 06 16:16:54.233856 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 93/186] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:54 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:54.253376 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-43beebd7-f6b8-4142-9088-a0aa96bc78df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:54.253998 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-43beebd7-f6b8-4142-9088-a0aa96bc78df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:54.260371 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43beebd7-f6b8-4142-9088-a0aa96bc78df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.260902 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43beebd7-f6b8-4142-9088-a0aa96bc78df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.261344 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43beebd7-f6b8-4142-9088-a0aa96bc78df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.262048 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43beebd7-f6b8-4142-9088-a0aa96bc78df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.262497 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43beebd7-f6b8-4142-9088-a0aa96bc78df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.262932 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43beebd7-f6b8-4142-9088-a0aa96bc78df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.275702 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ed0febbe-b251-4b2e-8bc8-c69884dd9215 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:54.287485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ed0febbe-b251-4b2e-8bc8-c69884dd9215 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:54.289182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ed0febbe-b251-4b2e-8bc8-c69884dd9215 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:54.290279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ed0febbe-b251-4b2e-8bc8-c69884dd9215 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.184775 Sep 06 16:16:54.290820 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 94/187] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:54 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:54.295836 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-233d6b6d-cd21-4516-8668-0b7dda68b643 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:54.296624 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-233d6b6d-cd21-4516-8668-0b7dda68b643 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:54.304255 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-233d6b6d-cd21-4516-8668-0b7dda68b643 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.305205 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-233d6b6d-cd21-4516-8668-0b7dda68b643 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.306047 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-233d6b6d-cd21-4516-8668-0b7dda68b643 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.306923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-233d6b6d-cd21-4516-8668-0b7dda68b643 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.307563 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-233d6b6d-cd21-4516-8668-0b7dda68b643 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.308198 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-233d6b6d-cd21-4516-8668-0b7dda68b643 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.414573 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-43beebd7-f6b8-4142-9088-a0aa96bc78df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:54.423477 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-43beebd7-f6b8-4142-9088-a0aa96bc78df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.181253 Sep 06 16:16:54.424109 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 94/188] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:54 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:54.462630 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-233d6b6d-cd21-4516-8668-0b7dda68b643 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:54.474578 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-233d6b6d-cd21-4516-8668-0b7dda68b643 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.182273 Sep 06 16:16:54.475547 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 95/189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:54 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:55.258287 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-554f3c2b-1bf9-40d7-8dbd-807415f883b9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:55.258928 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-554f3c2b-1bf9-40d7-8dbd-807415f883b9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:55.266315 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-554f3c2b-1bf9-40d7-8dbd-807415f883b9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.266798 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-554f3c2b-1bf9-40d7-8dbd-807415f883b9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.267228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-554f3c2b-1bf9-40d7-8dbd-807415f883b9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.267929 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-554f3c2b-1bf9-40d7-8dbd-807415f883b9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.268374 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-554f3c2b-1bf9-40d7-8dbd-807415f883b9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.268820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-554f3c2b-1bf9-40d7-8dbd-807415f883b9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.320493 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d89a2e89-e765-430e-aa15-cab40f7c67e7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:55.321104 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d89a2e89-e765-430e-aa15-cab40f7c67e7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:55.327220 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d89a2e89-e765-430e-aa15-cab40f7c67e7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.327701 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d89a2e89-e765-430e-aa15-cab40f7c67e7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.328128 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d89a2e89-e765-430e-aa15-cab40f7c67e7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.328795 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d89a2e89-e765-430e-aa15-cab40f7c67e7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.329284 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d89a2e89-e765-430e-aa15-cab40f7c67e7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.329696 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d89a2e89-e765-430e-aa15-cab40f7c67e7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.417573 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-554f3c2b-1bf9-40d7-8dbd-807415f883b9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:55.427056 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-554f3c2b-1bf9-40d7-8dbd-807415f883b9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.172963 Sep 06 16:16:55.428709 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 95/190] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:55 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:55.462247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-dca24f2c-7337-4198-b4a3-2ea23add8602 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:55.462247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-dca24f2c-7337-4198-b4a3-2ea23add8602 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:55.468067 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dca24f2c-7337-4198-b4a3-2ea23add8602 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.468781 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dca24f2c-7337-4198-b4a3-2ea23add8602 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.469277 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dca24f2c-7337-4198-b4a3-2ea23add8602 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.470212 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dca24f2c-7337-4198-b4a3-2ea23add8602 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.470674 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dca24f2c-7337-4198-b4a3-2ea23add8602 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.471317 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dca24f2c-7337-4198-b4a3-2ea23add8602 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.492777 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d89a2e89-e765-430e-aa15-cab40f7c67e7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:55.500987 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d89a2e89-e765-430e-aa15-cab40f7c67e7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:55.502857 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d89a2e89-e765-430e-aa15-cab40f7c67e7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:55.504193 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d89a2e89-e765-430e-aa15-cab40f7c67e7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.187587 Sep 06 16:16:55.504944 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 96/191] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:55 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:55.509942 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f3d29dd4-c344-4ff5-a36d-03f33bf0cf7b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:55.511777 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f3d29dd4-c344-4ff5-a36d-03f33bf0cf7b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:55.519329 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3d29dd4-c344-4ff5-a36d-03f33bf0cf7b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.520100 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3d29dd4-c344-4ff5-a36d-03f33bf0cf7b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.520882 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3d29dd4-c344-4ff5-a36d-03f33bf0cf7b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.521579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3d29dd4-c344-4ff5-a36d-03f33bf0cf7b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.522225 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3d29dd4-c344-4ff5-a36d-03f33bf0cf7b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.522825 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3d29dd4-c344-4ff5-a36d-03f33bf0cf7b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.630422 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-dca24f2c-7337-4198-b4a3-2ea23add8602 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:55.641067 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-dca24f2c-7337-4198-b4a3-2ea23add8602 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.185748 Sep 06 16:16:55.641960 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 96/192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:55 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:55.693580 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f3d29dd4-c344-4ff5-a36d-03f33bf0cf7b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:55.701861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f3d29dd4-c344-4ff5-a36d-03f33bf0cf7b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.195552 Sep 06 16:16:55.702648 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 97/193] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:55 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:56.455100 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-38b482c7-f9b5-44d7-b42a-5eaeac088e7f tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:56.455870 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-38b482c7-f9b5-44d7-b42a-5eaeac088e7f tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:56.463890 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38b482c7-f9b5-44d7-b42a-5eaeac088e7f tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:56.464380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38b482c7-f9b5-44d7-b42a-5eaeac088e7f tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:56.464834 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38b482c7-f9b5-44d7-b42a-5eaeac088e7f tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:56.465538 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38b482c7-f9b5-44d7-b42a-5eaeac088e7f tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:56.465981 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38b482c7-f9b5-44d7-b42a-5eaeac088e7f tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:56.466396 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38b482c7-f9b5-44d7-b42a-5eaeac088e7f tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:56.531943 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a968d5de-48ec-4c9c-b029-43e4cce11041 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:56.531943 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a968d5de-48ec-4c9c-b029-43e4cce11041 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:56.538698 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a968d5de-48ec-4c9c-b029-43e4cce11041 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:56.539203 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a968d5de-48ec-4c9c-b029-43e4cce11041 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:56.539632 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a968d5de-48ec-4c9c-b029-43e4cce11041 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:56.540303 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a968d5de-48ec-4c9c-b029-43e4cce11041 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:56.540994 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a968d5de-48ec-4c9c-b029-43e4cce11041 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:56.541659 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a968d5de-48ec-4c9c-b029-43e4cce11041 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:56.630767 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-38b482c7-f9b5-44d7-b42a-5eaeac088e7f tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:56.638960 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-38b482c7-f9b5-44d7-b42a-5eaeac088e7f tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.190209 Sep 06 16:16:56.639846 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 97/194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:56 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:56.664936 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-646477fb-3c13-410c-bfa6-d80f152b070a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:56.665753 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-646477fb-3c13-410c-bfa6-d80f152b070a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:56.674549 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-646477fb-3c13-410c-bfa6-d80f152b070a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:56.675516 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-646477fb-3c13-410c-bfa6-d80f152b070a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:56.676432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-646477fb-3c13-410c-bfa6-d80f152b070a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:56.678546 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-646477fb-3c13-410c-bfa6-d80f152b070a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:56.679319 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-646477fb-3c13-410c-bfa6-d80f152b070a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:56.680052 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-646477fb-3c13-410c-bfa6-d80f152b070a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:56.754829 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a968d5de-48ec-4c9c-b029-43e4cce11041 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:56.766011 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a968d5de-48ec-4c9c-b029-43e4cce11041 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:56.767700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a968d5de-48ec-4c9c-b029-43e4cce11041 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:56.769986 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a968d5de-48ec-4c9c-b029-43e4cce11041 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.242437 Sep 06 16:16:56.770295 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 98/195] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:56 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:56.781155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-03e1c5af-f2af-4555-87df-cfa97e6dd24a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:56.782061 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-03e1c5af-f2af-4555-87df-cfa97e6dd24a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:56.793711 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03e1c5af-f2af-4555-87df-cfa97e6dd24a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:56.794535 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03e1c5af-f2af-4555-87df-cfa97e6dd24a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:56.795360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03e1c5af-f2af-4555-87df-cfa97e6dd24a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:56.796656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03e1c5af-f2af-4555-87df-cfa97e6dd24a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:56.797450 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03e1c5af-f2af-4555-87df-cfa97e6dd24a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:56.798411 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03e1c5af-f2af-4555-87df-cfa97e6dd24a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:56.869003 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-646477fb-3c13-410c-bfa6-d80f152b070a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:56.881769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-646477fb-3c13-410c-bfa6-d80f152b070a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.220494 Sep 06 16:16:56.883465 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 98/196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:56 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:57.021573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-03e1c5af-f2af-4555-87df-cfa97e6dd24a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:57.038392 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-03e1c5af-f2af-4555-87df-cfa97e6dd24a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.266031 Sep 06 16:16:57.039615 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 99/197] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:56 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:57.665231 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7060fa79-3cc7-4828-8bb9-392ca58b590d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:57.666664 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7060fa79-3cc7-4828-8bb9-392ca58b590d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:57.678227 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7060fa79-3cc7-4828-8bb9-392ca58b590d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:57.678952 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7060fa79-3cc7-4828-8bb9-392ca58b590d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:57.680567 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7060fa79-3cc7-4828-8bb9-392ca58b590d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:57.682336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7060fa79-3cc7-4828-8bb9-392ca58b590d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:57.683082 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7060fa79-3cc7-4828-8bb9-392ca58b590d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:57.684377 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7060fa79-3cc7-4828-8bb9-392ca58b590d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:57.800932 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-cb2c0fc7-a1de-4a51-9691-dd9217ee09df tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:57.801786 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-cb2c0fc7-a1de-4a51-9691-dd9217ee09df tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:57.813526 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cb2c0fc7-a1de-4a51-9691-dd9217ee09df tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:57.814031 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cb2c0fc7-a1de-4a51-9691-dd9217ee09df tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:57.814469 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cb2c0fc7-a1de-4a51-9691-dd9217ee09df tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:57.815188 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cb2c0fc7-a1de-4a51-9691-dd9217ee09df tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:57.815632 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cb2c0fc7-a1de-4a51-9691-dd9217ee09df tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:57.816043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cb2c0fc7-a1de-4a51-9691-dd9217ee09df tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:57.880325 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7060fa79-3cc7-4828-8bb9-392ca58b590d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:57.894485 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7060fa79-3cc7-4828-8bb9-392ca58b590d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.234646 Sep 06 16:16:57.894979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 99/198] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:57 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:57.914147 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-87a42bde-fb55-488b-b43a-4f1932e36581 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:57.916727 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-87a42bde-fb55-488b-b43a-4f1932e36581 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:57.934443 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-87a42bde-fb55-488b-b43a-4f1932e36581 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:57.935214 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-87a42bde-fb55-488b-b43a-4f1932e36581 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:57.938698 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-87a42bde-fb55-488b-b43a-4f1932e36581 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:57.956783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-87a42bde-fb55-488b-b43a-4f1932e36581 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:57.957613 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-87a42bde-fb55-488b-b43a-4f1932e36581 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:57.959762 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-87a42bde-fb55-488b-b43a-4f1932e36581 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:58.072488 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cb2c0fc7-a1de-4a51-9691-dd9217ee09df tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:58.083648 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cb2c0fc7-a1de-4a51-9691-dd9217ee09df tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:58.085131 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cb2c0fc7-a1de-4a51-9691-dd9217ee09df tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:58.086240 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-cb2c0fc7-a1de-4a51-9691-dd9217ee09df tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.290638 Sep 06 16:16:58.086961 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 100/199] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:57 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:58.091745 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2836fd15-b6e9-4597-87a8-544ebf643686 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:58.092420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2836fd15-b6e9-4597-87a8-544ebf643686 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:58.099387 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2836fd15-b6e9-4597-87a8-544ebf643686 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:58.099899 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2836fd15-b6e9-4597-87a8-544ebf643686 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:58.100294 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2836fd15-b6e9-4597-87a8-544ebf643686 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:58.101065 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2836fd15-b6e9-4597-87a8-544ebf643686 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:58.101686 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2836fd15-b6e9-4597-87a8-544ebf643686 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:58.102256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2836fd15-b6e9-4597-87a8-544ebf643686 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:58.106919 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:58.191569 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-87a42bde-fb55-488b-b43a-4f1932e36581 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:58.201679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-87a42bde-fb55-488b-b43a-4f1932e36581 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.299322 Sep 06 16:16:58.204999 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 100/200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:57 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:58.267541 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2836fd15-b6e9-4597-87a8-544ebf643686 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:58.282489 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2836fd15-b6e9-4597-87a8-544ebf643686 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.194172 Sep 06 16:16:58.283356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 101/201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:58 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:58.569180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-319cd4b9-5641-4b4e-b201-5eb7839d8189 req-28b98644-d61c-4bf3-b2cb-66bd7b434824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7a8803-c332-4dde-baee-ec2049243bf4", "name": "network-vif-plugged", "status": "completed", "tag": "c6993609-38ee-4cc3-b97f-75c88fcd8888"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:58.581339 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-319cd4b9-5641-4b4e-b201-5eb7839d8189 req-28b98644-d61c-4bf3-b2cb-66bd7b434824 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:58.582133 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-319cd4b9-5641-4b4e-b201-5eb7839d8189 req-28b98644-d61c-4bf3-b2cb-66bd7b434824 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:58.582926 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-319cd4b9-5641-4b4e-b201-5eb7839d8189 req-28b98644-d61c-4bf3-b2cb-66bd7b434824 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:58.610445 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-319cd4b9-5641-4b4e-b201-5eb7839d8189 req-28b98644-d61c-4bf3-b2cb-66bd7b434824 service nova] Creating event network-vif-plugged:c6993609-38ee-4cc3-b97f-75c88fcd8888 for instance af7a8803-c332-4dde-baee-ec2049243bf4 on hv-cinder-85221 Sep 06 16:16:58.620554 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-319cd4b9-5641-4b4e-b201-5eb7839d8189 req-28b98644-d61c-4bf3-b2cb-66bd7b434824 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244873 Sep 06 16:16:58.628240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 101/202] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:16:58.925156 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-77df9ed1-a17f-41ec-9b4d-abc8de39655e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:58.925775 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-77df9ed1-a17f-41ec-9b4d-abc8de39655e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:58.933410 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77df9ed1-a17f-41ec-9b4d-abc8de39655e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:58.933948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77df9ed1-a17f-41ec-9b4d-abc8de39655e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:58.934393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77df9ed1-a17f-41ec-9b4d-abc8de39655e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:58.935100 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77df9ed1-a17f-41ec-9b4d-abc8de39655e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:58.935704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77df9ed1-a17f-41ec-9b4d-abc8de39655e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:58.936297 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77df9ed1-a17f-41ec-9b4d-abc8de39655e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.106080 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-77df9ed1-a17f-41ec-9b4d-abc8de39655e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:59.115628 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-35501000-ad15-43bc-846b-cfba58aa1932 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:59.116989 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-35501000-ad15-43bc-846b-cfba58aa1932 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:59.119805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-77df9ed1-a17f-41ec-9b4d-abc8de39655e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.198678 Sep 06 16:16:59.121536 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 102/203] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:58 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:59.140367 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35501000-ad15-43bc-846b-cfba58aa1932 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:59.140988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35501000-ad15-43bc-846b-cfba58aa1932 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:59.141583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35501000-ad15-43bc-846b-cfba58aa1932 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.142485 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35501000-ad15-43bc-846b-cfba58aa1932 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:59.143086 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35501000-ad15-43bc-846b-cfba58aa1932 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:59.143879 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35501000-ad15-43bc-846b-cfba58aa1932 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.233613 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0602caef-98d6-4214-81c1-65ac54f5c1b2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:59.234214 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0602caef-98d6-4214-81c1-65ac54f5c1b2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:59.244111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0602caef-98d6-4214-81c1-65ac54f5c1b2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:59.244718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0602caef-98d6-4214-81c1-65ac54f5c1b2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:59.245241 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0602caef-98d6-4214-81c1-65ac54f5c1b2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.246700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0602caef-98d6-4214-81c1-65ac54f5c1b2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:59.247375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0602caef-98d6-4214-81c1-65ac54f5c1b2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:59.247886 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0602caef-98d6-4214-81c1-65ac54f5c1b2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.363761 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-35501000-ad15-43bc-846b-cfba58aa1932 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:59.374702 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-35501000-ad15-43bc-846b-cfba58aa1932 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:59.378321 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-35501000-ad15-43bc-846b-cfba58aa1932 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:59.381152 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-35501000-ad15-43bc-846b-cfba58aa1932 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.270106 Sep 06 16:16:59.382438 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 102/204] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:16:59 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:16:59.388875 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4b708cd6-c926-49f9-9518-2f679653d70d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:59.389937 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4b708cd6-c926-49f9-9518-2f679653d70d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:59.406453 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b708cd6-c926-49f9-9518-2f679653d70d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:59.408098 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b708cd6-c926-49f9-9518-2f679653d70d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:59.408983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b708cd6-c926-49f9-9518-2f679653d70d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.410849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b708cd6-c926-49f9-9518-2f679653d70d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:59.411855 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b708cd6-c926-49f9-9518-2f679653d70d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:59.412973 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b708cd6-c926-49f9-9518-2f679653d70d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.459020 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0602caef-98d6-4214-81c1-65ac54f5c1b2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:59.470785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0602caef-98d6-4214-81c1-65ac54f5c1b2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.242908 Sep 06 16:16:59.471991 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 103/205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:59 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:59.598202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4b708cd6-c926-49f9-9518-2f679653d70d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:59.613960 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4b708cd6-c926-49f9-9518-2f679653d70d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.229438 Sep 06 16:16:59.614821 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 103/206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:59 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:00.146851 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-54311fd5-5830-4123-a566-b73027845000 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:00.148346 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-54311fd5-5830-4123-a566-b73027845000 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:00.153588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-54311fd5-5830-4123-a566-b73027845000 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:00.154377 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-54311fd5-5830-4123-a566-b73027845000 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:00.154981 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-54311fd5-5830-4123-a566-b73027845000 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:00.156240 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-54311fd5-5830-4123-a566-b73027845000 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:00.160600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-54311fd5-5830-4123-a566-b73027845000 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:00.161384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-54311fd5-5830-4123-a566-b73027845000 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:00.391914 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-54311fd5-5830-4123-a566-b73027845000 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:00.408592 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-54311fd5-5830-4123-a566-b73027845000 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.266116 Sep 06 16:17:00.409782 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 104/207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:00 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:00.429638 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-71d3b047-037d-4188-b789-1e4d36b63057 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:00.430258 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-71d3b047-037d-4188-b789-1e4d36b63057 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:00.443224 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-71d3b047-037d-4188-b789-1e4d36b63057 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:00.443994 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-71d3b047-037d-4188-b789-1e4d36b63057 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:00.444812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-71d3b047-037d-4188-b789-1e4d36b63057 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:00.446181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-71d3b047-037d-4188-b789-1e4d36b63057 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:00.447049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-71d3b047-037d-4188-b789-1e4d36b63057 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:00.447772 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-71d3b047-037d-4188-b789-1e4d36b63057 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:00.498291 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7b81bf32-4dff-4dde-b0d0-9c053371e38c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:00.499386 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7b81bf32-4dff-4dde-b0d0-9c053371e38c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:00.513274 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7b81bf32-4dff-4dde-b0d0-9c053371e38c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:00.514292 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7b81bf32-4dff-4dde-b0d0-9c053371e38c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:00.514936 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7b81bf32-4dff-4dde-b0d0-9c053371e38c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:00.515840 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7b81bf32-4dff-4dde-b0d0-9c053371e38c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:00.516626 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7b81bf32-4dff-4dde-b0d0-9c053371e38c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:00.517318 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7b81bf32-4dff-4dde-b0d0-9c053371e38c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:00.816580 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-71d3b047-037d-4188-b789-1e4d36b63057 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:00.824066 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:00.835530 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-71d3b047-037d-4188-b789-1e4d36b63057 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:00.841247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-71d3b047-037d-4188-b789-1e4d36b63057 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:00.843785 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-71d3b047-037d-4188-b789-1e4d36b63057 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.436024 Sep 06 16:17:00.844587 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 104/208] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:17:00 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:17:00.869721 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b4a8f544-6c91-461a-96ea-d28f6cafccc2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:00.870352 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b4a8f544-6c91-461a-96ea-d28f6cafccc2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:00.881728 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b4a8f544-6c91-461a-96ea-d28f6cafccc2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:00.882217 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b4a8f544-6c91-461a-96ea-d28f6cafccc2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:00.884738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b4a8f544-6c91-461a-96ea-d28f6cafccc2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:00.885500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b4a8f544-6c91-461a-96ea-d28f6cafccc2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:00.885972 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b4a8f544-6c91-461a-96ea-d28f6cafccc2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:00.886403 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b4a8f544-6c91-461a-96ea-d28f6cafccc2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:01.070047 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b4a8f544-6c91-461a-96ea-d28f6cafccc2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:01.080684 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b4a8f544-6c91-461a-96ea-d28f6cafccc2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.221534 Sep 06 16:17:01.081435 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 105/209] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:00 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:01.095812 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7b81bf32-4dff-4dde-b0d0-9c053371e38c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:01.106319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7b81bf32-4dff-4dde-b0d0-9c053371e38c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.611877 Sep 06 16:17:01.122814 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 105/210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:00 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:01.439328 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-39502573-7a1c-4216-82e3-0d2bf95bbc48 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:01.440808 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-39502573-7a1c-4216-82e3-0d2bf95bbc48 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:01.449131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-39502573-7a1c-4216-82e3-0d2bf95bbc48 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:01.449901 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-39502573-7a1c-4216-82e3-0d2bf95bbc48 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:01.450777 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-39502573-7a1c-4216-82e3-0d2bf95bbc48 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:01.452099 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-39502573-7a1c-4216-82e3-0d2bf95bbc48 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:01.452780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-39502573-7a1c-4216-82e3-0d2bf95bbc48 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:01.453396 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-39502573-7a1c-4216-82e3-0d2bf95bbc48 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:01.641561 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-39502573-7a1c-4216-82e3-0d2bf95bbc48 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:01.650144 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-39502573-7a1c-4216-82e3-0d2bf95bbc48 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.215485 Sep 06 16:17:01.650790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 106/211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:01 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:01.881515 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5b38df73-c3f8-4839-8829-6740928f8f3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:01.882879 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5b38df73-c3f8-4839-8829-6740928f8f3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:01.892230 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5b38df73-c3f8-4839-8829-6740928f8f3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:01.892728 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5b38df73-c3f8-4839-8829-6740928f8f3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:01.893378 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5b38df73-c3f8-4839-8829-6740928f8f3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:01.894317 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5b38df73-c3f8-4839-8829-6740928f8f3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:01.895629 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5b38df73-c3f8-4839-8829-6740928f8f3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:01.896449 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5b38df73-c3f8-4839-8829-6740928f8f3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.093819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5b38df73-c3f8-4839-8829-6740928f8f3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:02.107678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b41a6fac-050d-47ea-9638-42e01f411451 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:02.108228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b41a6fac-050d-47ea-9638-42e01f411451 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:02.109855 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5b38df73-c3f8-4839-8829-6740928f8f3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:02.111308 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5b38df73-c3f8-4839-8829-6740928f8f3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:02.112664 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5b38df73-c3f8-4839-8829-6740928f8f3e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.240607 Sep 06 16:17:02.113400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 106/212] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:17:01 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:17:02.115911 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b41a6fac-050d-47ea-9638-42e01f411451 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.116400 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b41a6fac-050d-47ea-9638-42e01f411451 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.116917 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b41a6fac-050d-47ea-9638-42e01f411451 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.117970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b41a6fac-050d-47ea-9638-42e01f411451 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.118855 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b41a6fac-050d-47ea-9638-42e01f411451 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.119796 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b41a6fac-050d-47ea-9638-42e01f411451 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.134142 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-85f5ba79-9ec7-4594-bf1c-650547559ff6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:02.134802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-85f5ba79-9ec7-4594-bf1c-650547559ff6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:02.141516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85f5ba79-9ec7-4594-bf1c-650547559ff6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.142017 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85f5ba79-9ec7-4594-bf1c-650547559ff6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.142492 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85f5ba79-9ec7-4594-bf1c-650547559ff6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.143648 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85f5ba79-9ec7-4594-bf1c-650547559ff6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.144231 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85f5ba79-9ec7-4594-bf1c-650547559ff6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.144665 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85f5ba79-9ec7-4594-bf1c-650547559ff6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.302399 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b41a6fac-050d-47ea-9638-42e01f411451 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:02.311833 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b41a6fac-050d-47ea-9638-42e01f411451 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.211528 Sep 06 16:17:02.329380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 107/213] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:02 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:02.343906 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-85f5ba79-9ec7-4594-bf1c-650547559ff6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:02.354085 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-85f5ba79-9ec7-4594-bf1c-650547559ff6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.223781 Sep 06 16:17:02.369215 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 107/214] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:02 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:02.637202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-69fa8d5b-b0b3-4f7d-8676-bfaf2a1c2b2f req-5f54b8a8-1e98-42c0-bb41-281d8501a4fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2", "name": "network-vif-plugged", "status": "completed", "tag": "4b0a3d0f-c85a-40a8-b906-23e0735edd5e"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:02.649486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-69fa8d5b-b0b3-4f7d-8676-bfaf2a1c2b2f req-5f54b8a8-1e98-42c0-bb41-281d8501a4fb service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.650313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-69fa8d5b-b0b3-4f7d-8676-bfaf2a1c2b2f req-5f54b8a8-1e98-42c0-bb41-281d8501a4fb service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.651030 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-69fa8d5b-b0b3-4f7d-8676-bfaf2a1c2b2f req-5f54b8a8-1e98-42c0-bb41-281d8501a4fb service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.664295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-69fa8d5b-b0b3-4f7d-8676-bfaf2a1c2b2f req-5f54b8a8-1e98-42c0-bb41-281d8501a4fb service nova] Creating event network-vif-plugged:4b0a3d0f-c85a-40a8-b906-23e0735edd5e for instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 on hv-cinder-85221 Sep 06 16:17:02.672597 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-69fa8d5b-b0b3-4f7d-8676-bfaf2a1c2b2f req-5f54b8a8-1e98-42c0-bb41-281d8501a4fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039698 Sep 06 16:17:02.673626 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 108/215] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:02.678829 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4c561296-e146-45c7-9d94-6ea416ad5c81 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:02.679505 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4c561296-e146-45c7-9d94-6ea416ad5c81 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:02.686231 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4c561296-e146-45c7-9d94-6ea416ad5c81 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.686710 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4c561296-e146-45c7-9d94-6ea416ad5c81 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.687195 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4c561296-e146-45c7-9d94-6ea416ad5c81 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.688550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4c561296-e146-45c7-9d94-6ea416ad5c81 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.689099 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4c561296-e146-45c7-9d94-6ea416ad5c81 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.690203 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4c561296-e146-45c7-9d94-6ea416ad5c81 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.855604 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4c561296-e146-45c7-9d94-6ea416ad5c81 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:02.865725 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4c561296-e146-45c7-9d94-6ea416ad5c81 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.193661 Sep 06 16:17:02.877786 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 108/216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:02 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:03.140427 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-57f31faf-9060-4ca6-88cd-d997cd063fd7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:03.141057 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-57f31faf-9060-4ca6-88cd-d997cd063fd7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:03.150346 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57f31faf-9060-4ca6-88cd-d997cd063fd7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:03.151200 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57f31faf-9060-4ca6-88cd-d997cd063fd7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:03.151871 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57f31faf-9060-4ca6-88cd-d997cd063fd7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:03.152997 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57f31faf-9060-4ca6-88cd-d997cd063fd7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:03.153684 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57f31faf-9060-4ca6-88cd-d997cd063fd7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:03.154325 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57f31faf-9060-4ca6-88cd-d997cd063fd7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:03.338519 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3a1705f8-9e16-484b-97c0-314c502b4365 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:03.339100 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3a1705f8-9e16-484b-97c0-314c502b4365 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:03.348395 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3a1705f8-9e16-484b-97c0-314c502b4365 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:03.349257 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3a1705f8-9e16-484b-97c0-314c502b4365 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:03.350191 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3a1705f8-9e16-484b-97c0-314c502b4365 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:03.351157 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3a1705f8-9e16-484b-97c0-314c502b4365 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:03.351834 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3a1705f8-9e16-484b-97c0-314c502b4365 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:03.352455 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3a1705f8-9e16-484b-97c0-314c502b4365 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:03.368601 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-57f31faf-9060-4ca6-88cd-d997cd063fd7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:03.383912 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-57f31faf-9060-4ca6-88cd-d997cd063fd7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:03.386243 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-57f31faf-9060-4ca6-88cd-d997cd063fd7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:03.388083 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-57f31faf-9060-4ca6-88cd-d997cd063fd7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.252541 Sep 06 16:17:03.393412 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 109/217] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:17:03 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:17:03.403490 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1fb72f68-cee1-448f-be3e-97482f553a66 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:03.404691 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1fb72f68-cee1-448f-be3e-97482f553a66 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:03.428895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fb72f68-cee1-448f-be3e-97482f553a66 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:03.429390 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fb72f68-cee1-448f-be3e-97482f553a66 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:03.429821 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fb72f68-cee1-448f-be3e-97482f553a66 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:03.430521 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fb72f68-cee1-448f-be3e-97482f553a66 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:03.430966 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fb72f68-cee1-448f-be3e-97482f553a66 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:03.431385 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fb72f68-cee1-448f-be3e-97482f553a66 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:03.593823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1fb72f68-cee1-448f-be3e-97482f553a66 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:03.603732 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1fb72f68-cee1-448f-be3e-97482f553a66 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.204173 Sep 06 16:17:03.604561 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 110/218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:03 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:03.621067 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3a1705f8-9e16-484b-97c0-314c502b4365 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:03.621067 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3a1705f8-9e16-484b-97c0-314c502b4365 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.285605 Sep 06 16:17:03.621593 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 109/219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:03 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:03.893494 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-8bdc05de-6105-470f-8aed-935667f8a683 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:03.895159 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-8bdc05de-6105-470f-8aed-935667f8a683 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:03.906154 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8bdc05de-6105-470f-8aed-935667f8a683 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:03.906979 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8bdc05de-6105-470f-8aed-935667f8a683 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:03.907777 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8bdc05de-6105-470f-8aed-935667f8a683 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:03.909127 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8bdc05de-6105-470f-8aed-935667f8a683 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:03.909800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8bdc05de-6105-470f-8aed-935667f8a683 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:03.910394 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8bdc05de-6105-470f-8aed-935667f8a683 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.074641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8bdc05de-6105-470f-8aed-935667f8a683 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:04.083027 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-8bdc05de-6105-470f-8aed-935667f8a683 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.196573 Sep 06 16:17:04.084451 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 110/220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:03 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:04.424108 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ac61a2e3-c57a-44b0-82b6-88ba7a0511ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:04.424723 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ac61a2e3-c57a-44b0-82b6-88ba7a0511ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:04.439677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac61a2e3-c57a-44b0-82b6-88ba7a0511ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.439677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac61a2e3-c57a-44b0-82b6-88ba7a0511ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.439677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac61a2e3-c57a-44b0-82b6-88ba7a0511ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.439677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac61a2e3-c57a-44b0-82b6-88ba7a0511ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.440010 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac61a2e3-c57a-44b0-82b6-88ba7a0511ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.440010 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac61a2e3-c57a-44b0-82b6-88ba7a0511ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.622834 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ac61a2e3-c57a-44b0-82b6-88ba7a0511ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:04.632449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ac61a2e3-c57a-44b0-82b6-88ba7a0511ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:04.634518 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ac61a2e3-c57a-44b0-82b6-88ba7a0511ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:04.635666 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fa6eb84b-2a2f-498a-b7a7-99ae43751f09 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:04.636182 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ac61a2e3-c57a-44b0-82b6-88ba7a0511ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.218602 Sep 06 16:17:04.636627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fa6eb84b-2a2f-498a-b7a7-99ae43751f09 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:04.648806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 111/221] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:17:04 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:17:04.648806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-43bbb9a9-21ab-4533-a6ed-961ce3716e71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:04.648806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-43bbb9a9-21ab-4533-a6ed-961ce3716e71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:04.649255 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fa6eb84b-2a2f-498a-b7a7-99ae43751f09 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.649255 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fa6eb84b-2a2f-498a-b7a7-99ae43751f09 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.649255 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fa6eb84b-2a2f-498a-b7a7-99ae43751f09 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.649255 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fa6eb84b-2a2f-498a-b7a7-99ae43751f09 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.649532 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fa6eb84b-2a2f-498a-b7a7-99ae43751f09 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.649532 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fa6eb84b-2a2f-498a-b7a7-99ae43751f09 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.653208 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43bbb9a9-21ab-4533-a6ed-961ce3716e71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.653940 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43bbb9a9-21ab-4533-a6ed-961ce3716e71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.654378 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43bbb9a9-21ab-4533-a6ed-961ce3716e71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.655081 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43bbb9a9-21ab-4533-a6ed-961ce3716e71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.655530 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43bbb9a9-21ab-4533-a6ed-961ce3716e71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.655948 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43bbb9a9-21ab-4533-a6ed-961ce3716e71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.805689 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fa6eb84b-2a2f-498a-b7a7-99ae43751f09 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:04.814228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fa6eb84b-2a2f-498a-b7a7-99ae43751f09 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.185306 Sep 06 16:17:04.814866 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 111/222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:04 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:04.824738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-43bbb9a9-21ab-4533-a6ed-961ce3716e71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:04.832363 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-43bbb9a9-21ab-4533-a6ed-961ce3716e71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.191796 Sep 06 16:17:04.832956 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 112/223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:04 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:05.012451 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-2998b950-fb55-4802-94e8-5f1dcd871aff req-bcbc6432-4a9d-4ff2-813b-033bbbd5f1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d1b8c7-0e2d-4897-9945-2c9b6dec52a9", "name": "network-vif-plugged", "status": "completed", "tag": "f0247727-02b0-4655-ace0-070a17630877"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:05.031014 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-2998b950-fb55-4802-94e8-5f1dcd871aff req-bcbc6432-4a9d-4ff2-813b-033bbbd5f1cf service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.032405 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-2998b950-fb55-4802-94e8-5f1dcd871aff req-bcbc6432-4a9d-4ff2-813b-033bbbd5f1cf service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.033448 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-2998b950-fb55-4802-94e8-5f1dcd871aff req-bcbc6432-4a9d-4ff2-813b-033bbbd5f1cf service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.050444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-2998b950-fb55-4802-94e8-5f1dcd871aff req-bcbc6432-4a9d-4ff2-813b-033bbbd5f1cf service nova] Creating event network-vif-plugged:f0247727-02b0-4655-ace0-070a17630877 for instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 on hv-cinder-85221 Sep 06 16:17:05.056595 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-2998b950-fb55-4802-94e8-5f1dcd871aff req-bcbc6432-4a9d-4ff2-813b-033bbbd5f1cf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049564 Sep 06 16:17:05.058000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 112/224] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:05.108198 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4348bcb2-4acf-4a1e-8b61-cdee6be9d769 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:05.109395 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4348bcb2-4acf-4a1e-8b61-cdee6be9d769 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:05.120813 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4348bcb2-4acf-4a1e-8b61-cdee6be9d769 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.122494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4348bcb2-4acf-4a1e-8b61-cdee6be9d769 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.123166 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4348bcb2-4acf-4a1e-8b61-cdee6be9d769 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.133360 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4348bcb2-4acf-4a1e-8b61-cdee6be9d769 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.133360 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4348bcb2-4acf-4a1e-8b61-cdee6be9d769 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.133360 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4348bcb2-4acf-4a1e-8b61-cdee6be9d769 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.285956 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4348bcb2-4acf-4a1e-8b61-cdee6be9d769 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:05.294353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4348bcb2-4acf-4a1e-8b61-cdee6be9d769 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.190728 Sep 06 16:17:05.295176 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 113/225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:05 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:05.666807 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9b093d2d-f2de-4fe2-8377-8c55bf17d13b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:05.667485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9b093d2d-f2de-4fe2-8377-8c55bf17d13b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:05.674184 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b093d2d-f2de-4fe2-8377-8c55bf17d13b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.674669 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b093d2d-f2de-4fe2-8377-8c55bf17d13b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.675095 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b093d2d-f2de-4fe2-8377-8c55bf17d13b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.675769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b093d2d-f2de-4fe2-8377-8c55bf17d13b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.676213 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b093d2d-f2de-4fe2-8377-8c55bf17d13b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.676638 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b093d2d-f2de-4fe2-8377-8c55bf17d13b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.829213 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9b093d2d-f2de-4fe2-8377-8c55bf17d13b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:05.838679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-aaf7ab2b-c845-4476-b593-38974539e721 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:05.839308 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9b093d2d-f2de-4fe2-8377-8c55bf17d13b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:05.839492 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-aaf7ab2b-c845-4476-b593-38974539e721 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:05.840681 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9b093d2d-f2de-4fe2-8377-8c55bf17d13b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:05.841807 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9b093d2d-f2de-4fe2-8377-8c55bf17d13b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.179388 Sep 06 16:17:05.842353 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 113/226] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:17:05 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:17:05.846694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab2b-c845-4476-b593-38974539e721 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.847247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab2b-c845-4476-b593-38974539e721 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.847879 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab2b-c845-4476-b593-38974539e721 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.848583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab2b-c845-4476-b593-38974539e721 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.849069 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab2b-c845-4476-b593-38974539e721 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.849790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab2b-c845-4476-b593-38974539e721 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.857558 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e64bbc22-fc29-45ee-b8ae-afee0eea3f52 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:05.858167 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e64bbc22-fc29-45ee-b8ae-afee0eea3f52 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:05.864591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e64bbc22-fc29-45ee-b8ae-afee0eea3f52 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.868063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e64bbc22-fc29-45ee-b8ae-afee0eea3f52 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.868063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e64bbc22-fc29-45ee-b8ae-afee0eea3f52 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.868063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e64bbc22-fc29-45ee-b8ae-afee0eea3f52 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.868063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e64bbc22-fc29-45ee-b8ae-afee0eea3f52 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.868532 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e64bbc22-fc29-45ee-b8ae-afee0eea3f52 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.998703 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-aaf7ab2b-c845-4476-b593-38974539e721 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:06.008253 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-aaf7ab2b-c845-4476-b593-38974539e721 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.173332 Sep 06 16:17:06.011146 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 114/227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:05 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:06.011520 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e64bbc22-fc29-45ee-b8ae-afee0eea3f52 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:06.021047 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e64bbc22-fc29-45ee-b8ae-afee0eea3f52 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.167334 Sep 06 16:17:06.021973 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 114/228] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:05 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:06.330083 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d2613258-32e4-432f-83ed-3d93a3a3bb26 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:06.330698 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d2613258-32e4-432f-83ed-3d93a3a3bb26 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:06.336837 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d2613258-32e4-432f-83ed-3d93a3a3bb26 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:06.337346 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d2613258-32e4-432f-83ed-3d93a3a3bb26 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:06.337774 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d2613258-32e4-432f-83ed-3d93a3a3bb26 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:06.338491 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d2613258-32e4-432f-83ed-3d93a3a3bb26 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:06.338926 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d2613258-32e4-432f-83ed-3d93a3a3bb26 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:06.339345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d2613258-32e4-432f-83ed-3d93a3a3bb26 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:06.488362 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d2613258-32e4-432f-83ed-3d93a3a3bb26 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:06.497586 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d2613258-32e4-432f-83ed-3d93a3a3bb26 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.171412 Sep 06 16:17:06.497586 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 115/229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:06 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:06.870425 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d063263b-22ca-4d63-b14c-36cc359fd8b4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:06.870990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d063263b-22ca-4d63-b14c-36cc359fd8b4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:06.878685 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d063263b-22ca-4d63-b14c-36cc359fd8b4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:06.879526 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d063263b-22ca-4d63-b14c-36cc359fd8b4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:06.880023 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d063263b-22ca-4d63-b14c-36cc359fd8b4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:06.880914 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d063263b-22ca-4d63-b14c-36cc359fd8b4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:06.881375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d063263b-22ca-4d63-b14c-36cc359fd8b4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:06.881797 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d063263b-22ca-4d63-b14c-36cc359fd8b4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.035449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9ff66c4c-5047-4548-aa32-0d686b13c372 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:07.036134 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9ff66c4c-5047-4548-aa32-0d686b13c372 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:07.040775 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d063263b-22ca-4d63-b14c-36cc359fd8b4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:07.043355 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9ff66c4c-5047-4548-aa32-0d686b13c372 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.044048 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9ff66c4c-5047-4548-aa32-0d686b13c372 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.044735 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9ff66c4c-5047-4548-aa32-0d686b13c372 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.046100 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9ff66c4c-5047-4548-aa32-0d686b13c372 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.046664 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9ff66c4c-5047-4548-aa32-0d686b13c372 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.047210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9ff66c4c-5047-4548-aa32-0d686b13c372 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.051782 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d063263b-22ca-4d63-b14c-36cc359fd8b4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:07.055188 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d063263b-22ca-4d63-b14c-36cc359fd8b4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:07.056574 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d063263b-22ca-4d63-b14c-36cc359fd8b4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.190470 Sep 06 16:17:07.057293 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 115/230] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:17:06 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:17:07.063035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c1105c97-7a35-48b4-9671-57cbbcd4e8c8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:07.063737 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c1105c97-7a35-48b4-9671-57cbbcd4e8c8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:07.070900 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c1105c97-7a35-48b4-9671-57cbbcd4e8c8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.071388 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c1105c97-7a35-48b4-9671-57cbbcd4e8c8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.072563 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c1105c97-7a35-48b4-9671-57cbbcd4e8c8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.073317 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c1105c97-7a35-48b4-9671-57cbbcd4e8c8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.073770 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c1105c97-7a35-48b4-9671-57cbbcd4e8c8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.074256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c1105c97-7a35-48b4-9671-57cbbcd4e8c8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.210033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9ff66c4c-5047-4548-aa32-0d686b13c372 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:07.218089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9ff66c4c-5047-4548-aa32-0d686b13c372 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.187754 Sep 06 16:17:07.218672 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 116/231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:07 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:07.232860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c1105c97-7a35-48b4-9671-57cbbcd4e8c8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:07.241049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c1105c97-7a35-48b4-9671-57cbbcd4e8c8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.182522 Sep 06 16:17:07.241579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 116/232] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:07 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:07.521457 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-db514150-26f4-4fd8-ba74-a889eb1fe26c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:07.522077 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-db514150-26f4-4fd8-ba74-a889eb1fe26c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:07.528478 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-db514150-26f4-4fd8-ba74-a889eb1fe26c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.529005 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-db514150-26f4-4fd8-ba74-a889eb1fe26c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.529436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-db514150-26f4-4fd8-ba74-a889eb1fe26c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.530146 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-db514150-26f4-4fd8-ba74-a889eb1fe26c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.530591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-db514150-26f4-4fd8-ba74-a889eb1fe26c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.531046 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-db514150-26f4-4fd8-ba74-a889eb1fe26c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.697470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-db514150-26f4-4fd8-ba74-a889eb1fe26c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:07.708899 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-db514150-26f4-4fd8-ba74-a889eb1fe26c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.191191 Sep 06 16:17:07.709775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 117/233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:07 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:08.089735 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-712dbf67-dda0-4e1f-978a-3fc70ddf35fd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:08.090380 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-712dbf67-dda0-4e1f-978a-3fc70ddf35fd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:08.098709 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-712dbf67-dda0-4e1f-978a-3fc70ddf35fd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.099238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-712dbf67-dda0-4e1f-978a-3fc70ddf35fd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.099652 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-712dbf67-dda0-4e1f-978a-3fc70ddf35fd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.100621 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-712dbf67-dda0-4e1f-978a-3fc70ddf35fd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.101294 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-712dbf67-dda0-4e1f-978a-3fc70ddf35fd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.101883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-712dbf67-dda0-4e1f-978a-3fc70ddf35fd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.242257 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d06625aa-535e-4ce2-a8a6-11bf866911d1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:08.242838 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d06625aa-535e-4ce2-a8a6-11bf866911d1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:08.249722 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d06625aa-535e-4ce2-a8a6-11bf866911d1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.250210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d06625aa-535e-4ce2-a8a6-11bf866911d1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.250778 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d06625aa-535e-4ce2-a8a6-11bf866911d1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.251692 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d06625aa-535e-4ce2-a8a6-11bf866911d1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.251992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d06625aa-535e-4ce2-a8a6-11bf866911d1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.252640 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d06625aa-535e-4ce2-a8a6-11bf866911d1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.253794 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-712dbf67-dda0-4e1f-978a-3fc70ddf35fd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:08.264917 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-712dbf67-dda0-4e1f-978a-3fc70ddf35fd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:08.266376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-712dbf67-dda0-4e1f-978a-3fc70ddf35fd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:08.269677 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-712dbf67-dda0-4e1f-978a-3fc70ddf35fd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.182275 Sep 06 16:17:08.269677 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 117/234] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:17:08 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:17:08.274828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a00d2054-4a84-40b4-8665-2059fe1294d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:08.275789 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a00d2054-4a84-40b4-8665-2059fe1294d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:08.284933 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a00d2054-4a84-40b4-8665-2059fe1294d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.285743 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a00d2054-4a84-40b4-8665-2059fe1294d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.286508 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a00d2054-4a84-40b4-8665-2059fe1294d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.287708 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a00d2054-4a84-40b4-8665-2059fe1294d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.288455 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a00d2054-4a84-40b4-8665-2059fe1294d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.289221 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a00d2054-4a84-40b4-8665-2059fe1294d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.314800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:08.401504 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d06625aa-535e-4ce2-a8a6-11bf866911d1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:08.410758 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d06625aa-535e-4ce2-a8a6-11bf866911d1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.172947 Sep 06 16:17:08.411608 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 118/235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:08 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:08.634253 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a00d2054-4a84-40b4-8665-2059fe1294d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:08.642496 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a00d2054-4a84-40b4-8665-2059fe1294d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.372339 Sep 06 16:17:08.643089 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 118/236] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:08 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:08.735909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a6cce286-0801-40e3-889c-f73f5c3b35f7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:08.736684 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a6cce286-0801-40e3-889c-f73f5c3b35f7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:08.748844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6cce286-0801-40e3-889c-f73f5c3b35f7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.749595 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6cce286-0801-40e3-889c-f73f5c3b35f7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.750435 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6cce286-0801-40e3-889c-f73f5c3b35f7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.751345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6cce286-0801-40e3-889c-f73f5c3b35f7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.752250 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6cce286-0801-40e3-889c-f73f5c3b35f7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.753181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6cce286-0801-40e3-889c-f73f5c3b35f7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.913972 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a6cce286-0801-40e3-889c-f73f5c3b35f7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:08.924085 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a6cce286-0801-40e3-889c-f73f5c3b35f7 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.194732 Sep 06 16:17:08.925340 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 119/237] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:08 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:09.295229 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0a5c444d-49b1-4b0f-be6d-55b30d28555d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:09.295780 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0a5c444d-49b1-4b0f-be6d-55b30d28555d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:09.304667 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0a5c444d-49b1-4b0f-be6d-55b30d28555d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.305339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0a5c444d-49b1-4b0f-be6d-55b30d28555d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.305976 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0a5c444d-49b1-4b0f-be6d-55b30d28555d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.306827 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0a5c444d-49b1-4b0f-be6d-55b30d28555d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.307429 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0a5c444d-49b1-4b0f-be6d-55b30d28555d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.308028 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0a5c444d-49b1-4b0f-be6d-55b30d28555d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.443357 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-13b3466d-9588-432d-b61e-a3510f195d9a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:09.444036 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-13b3466d-9588-432d-b61e-a3510f195d9a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:09.444238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0a5c444d-49b1-4b0f-be6d-55b30d28555d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:09.450834 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-13b3466d-9588-432d-b61e-a3510f195d9a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.451325 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-13b3466d-9588-432d-b61e-a3510f195d9a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.452747 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-13b3466d-9588-432d-b61e-a3510f195d9a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.453653 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-13b3466d-9588-432d-b61e-a3510f195d9a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.454467 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-13b3466d-9588-432d-b61e-a3510f195d9a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.454919 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-13b3466d-9588-432d-b61e-a3510f195d9a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.455360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0a5c444d-49b1-4b0f-be6d-55b30d28555d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:09.457057 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0a5c444d-49b1-4b0f-be6d-55b30d28555d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:09.458202 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0a5c444d-49b1-4b0f-be6d-55b30d28555d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.169060 Sep 06 16:17:09.459042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 119/238] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:17:09 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:17:09.594714 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-13b3466d-9588-432d-b61e-a3510f195d9a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:09.602675 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-13b3466d-9588-432d-b61e-a3510f195d9a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.163755 Sep 06 16:17:09.603313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 120/239] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:09 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:09.666244 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-68d3f9c8-03b5-4b25-bf26-c5c41578a18c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:09.667237 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-68d3f9c8-03b5-4b25-bf26-c5c41578a18c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:09.674658 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-68d3f9c8-03b5-4b25-bf26-c5c41578a18c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.675147 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-68d3f9c8-03b5-4b25-bf26-c5c41578a18c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.675596 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-68d3f9c8-03b5-4b25-bf26-c5c41578a18c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.676292 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-68d3f9c8-03b5-4b25-bf26-c5c41578a18c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.676895 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-68d3f9c8-03b5-4b25-bf26-c5c41578a18c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.677243 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-68d3f9c8-03b5-4b25-bf26-c5c41578a18c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.934984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-68d3f9c8-03b5-4b25-bf26-c5c41578a18c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:09.942628 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-68d3f9c8-03b5-4b25-bf26-c5c41578a18c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.279162 Sep 06 16:17:09.958700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 120/240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:09 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:09.963762 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a7b3dff5-643a-446e-83c9-c1bfba04d02d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:09.964349 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a7b3dff5-643a-446e-83c9-c1bfba04d02d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:09.973775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7b3dff5-643a-446e-83c9-c1bfba04d02d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.976089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7b3dff5-643a-446e-83c9-c1bfba04d02d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.976571 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7b3dff5-643a-446e-83c9-c1bfba04d02d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.977825 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7b3dff5-643a-446e-83c9-c1bfba04d02d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.978284 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7b3dff5-643a-446e-83c9-c1bfba04d02d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.978712 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7b3dff5-643a-446e-83c9-c1bfba04d02d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.138433 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a7b3dff5-643a-446e-83c9-c1bfba04d02d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:10.150602 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a7b3dff5-643a-446e-83c9-c1bfba04d02d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.206538 Sep 06 16:17:10.152461 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 121/241] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:09 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:10.484558 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-76b92053-9cfb-4fe3-b7e3-325b28d2a007 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:10.485135 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-76b92053-9cfb-4fe3-b7e3-325b28d2a007 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:10.491611 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76b92053-9cfb-4fe3-b7e3-325b28d2a007 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.492090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76b92053-9cfb-4fe3-b7e3-325b28d2a007 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.492523 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76b92053-9cfb-4fe3-b7e3-325b28d2a007 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.493252 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76b92053-9cfb-4fe3-b7e3-325b28d2a007 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.493701 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76b92053-9cfb-4fe3-b7e3-325b28d2a007 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.494121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76b92053-9cfb-4fe3-b7e3-325b28d2a007 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.626371 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8ffc8ea0-2be1-47e6-b72c-2758a42fc928 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:10.626962 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8ffc8ea0-2be1-47e6-b72c-2758a42fc928 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:10.633241 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8ffc8ea0-2be1-47e6-b72c-2758a42fc928 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.633723 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8ffc8ea0-2be1-47e6-b72c-2758a42fc928 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.634158 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8ffc8ea0-2be1-47e6-b72c-2758a42fc928 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.634846 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8ffc8ea0-2be1-47e6-b72c-2758a42fc928 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.635293 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8ffc8ea0-2be1-47e6-b72c-2758a42fc928 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.635704 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8ffc8ea0-2be1-47e6-b72c-2758a42fc928 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.639934 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:10.641942 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-76b92053-9cfb-4fe3-b7e3-325b28d2a007 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:10.650423 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-76b92053-9cfb-4fe3-b7e3-325b28d2a007 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:10.651896 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-76b92053-9cfb-4fe3-b7e3-325b28d2a007 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:10.653237 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-76b92053-9cfb-4fe3-b7e3-325b28d2a007 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.172758 Sep 06 16:17:10.654512 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 121/242] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:17:10 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:17:10.775099 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8ffc8ea0-2be1-47e6-b72c-2758a42fc928 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:10.786666 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8ffc8ea0-2be1-47e6-b72c-2758a42fc928 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.163935 Sep 06 16:17:10.787245 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 122/243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:10 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:10.965924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6c518732-237a-4a2c-92d4-617907b9b254 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:10.966533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6c518732-237a-4a2c-92d4-617907b9b254 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:10.972717 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6c518732-237a-4a2c-92d4-617907b9b254 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.973276 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6c518732-237a-4a2c-92d4-617907b9b254 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.973667 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6c518732-237a-4a2c-92d4-617907b9b254 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.974391 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6c518732-237a-4a2c-92d4-617907b9b254 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.974824 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6c518732-237a-4a2c-92d4-617907b9b254 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.975237 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6c518732-237a-4a2c-92d4-617907b9b254 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.110024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6c518732-237a-4a2c-92d4-617907b9b254 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:11.118767 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6c518732-237a-4a2c-92d4-617907b9b254 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.156781 Sep 06 16:17:11.122330 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 122/244] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:10 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:11.175475 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d8293244-c702-4638-940a-b0e291e8cd9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:11.176091 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d8293244-c702-4638-940a-b0e291e8cd9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:11.182560 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8293244-c702-4638-940a-b0e291e8cd9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.183075 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8293244-c702-4638-940a-b0e291e8cd9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.183535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8293244-c702-4638-940a-b0e291e8cd9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.184287 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8293244-c702-4638-940a-b0e291e8cd9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.184709 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8293244-c702-4638-940a-b0e291e8cd9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.185178 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8293244-c702-4638-940a-b0e291e8cd9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.533029 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d8293244-c702-4638-940a-b0e291e8cd9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:11.541631 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d8293244-c702-4638-940a-b0e291e8cd9c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1315 microversion: 2.1 time: 0.370552 Sep 06 16:17:11.542216 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 123/245] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:11 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:11.559458 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-2d02764f-23b4-4d71-8cff-af7806b13254 req-d510f2b1-9bfa-4dcd-a451-c0128c5e27d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc140df-902e-4875-822f-53831e91b1c3", "name": "network-vif-plugged", "status": "completed", "tag": "42ae6570-50c2-4446-95be-d0b723ac181e"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:11.570940 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-2d02764f-23b4-4d71-8cff-af7806b13254 req-d510f2b1-9bfa-4dcd-a451-c0128c5e27d9 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.571425 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-2d02764f-23b4-4d71-8cff-af7806b13254 req-d510f2b1-9bfa-4dcd-a451-c0128c5e27d9 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.571848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-2d02764f-23b4-4d71-8cff-af7806b13254 req-d510f2b1-9bfa-4dcd-a451-c0128c5e27d9 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.586480 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-2d02764f-23b4-4d71-8cff-af7806b13254 req-d510f2b1-9bfa-4dcd-a451-c0128c5e27d9 service nova] Creating event network-vif-plugged:42ae6570-50c2-4446-95be-d0b723ac181e for instance dbc140df-902e-4875-822f-53831e91b1c3 on hv-cinder-85221 Sep 06 16:17:11.592451 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-2d02764f-23b4-4d71-8cff-af7806b13254 req-d510f2b1-9bfa-4dcd-a451-c0128c5e27d9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036775 Sep 06 16:17:11.593471 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 123/246] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:11.679744 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0504408a-c26b-41d2-8fdd-cee87b0f69e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:11.680400 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0504408a-c26b-41d2-8fdd-cee87b0f69e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:11.686378 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0504408a-c26b-41d2-8fdd-cee87b0f69e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.687456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0504408a-c26b-41d2-8fdd-cee87b0f69e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.687916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0504408a-c26b-41d2-8fdd-cee87b0f69e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.688922 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0504408a-c26b-41d2-8fdd-cee87b0f69e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.689509 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0504408a-c26b-41d2-8fdd-cee87b0f69e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.689956 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0504408a-c26b-41d2-8fdd-cee87b0f69e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.813705 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4e66367f-3b51-4991-817f-af6b9925eacd tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:11.814609 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4e66367f-3b51-4991-817f-af6b9925eacd tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:11.821214 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e66367f-3b51-4991-817f-af6b9925eacd tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.821970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e66367f-3b51-4991-817f-af6b9925eacd tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.823379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e66367f-3b51-4991-817f-af6b9925eacd tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.824443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e66367f-3b51-4991-817f-af6b9925eacd tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.825081 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e66367f-3b51-4991-817f-af6b9925eacd tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.825800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e66367f-3b51-4991-817f-af6b9925eacd tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.841506 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0504408a-c26b-41d2-8fdd-cee87b0f69e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:11.852134 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0504408a-c26b-41d2-8fdd-cee87b0f69e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:11.853720 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0504408a-c26b-41d2-8fdd-cee87b0f69e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:11.854897 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0504408a-c26b-41d2-8fdd-cee87b0f69e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.179222 Sep 06 16:17:11.866069 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 124/247] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:17:11 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:17:11.966434 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4e66367f-3b51-4991-817f-af6b9925eacd tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:11.974755 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4e66367f-3b51-4991-817f-af6b9925eacd tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.166463 Sep 06 16:17:11.975344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 124/248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:11 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:12.141093 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1af5517d-1b0a-4f0f-b342-9ca0b2e0aee6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:12.141598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1af5517d-1b0a-4f0f-b342-9ca0b2e0aee6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:12.148093 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1af5517d-1b0a-4f0f-b342-9ca0b2e0aee6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.148588 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1af5517d-1b0a-4f0f-b342-9ca0b2e0aee6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.149042 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1af5517d-1b0a-4f0f-b342-9ca0b2e0aee6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:12.149729 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1af5517d-1b0a-4f0f-b342-9ca0b2e0aee6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.150179 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1af5517d-1b0a-4f0f-b342-9ca0b2e0aee6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.150600 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1af5517d-1b0a-4f0f-b342-9ca0b2e0aee6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:12.491222 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1af5517d-1b0a-4f0f-b342-9ca0b2e0aee6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:12.499610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1af5517d-1b0a-4f0f-b342-9ca0b2e0aee6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.362566 Sep 06 16:17:12.500537 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 125/249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:12 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:12.564878 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2aeaa6a6-f0f6-4a83-9a45-e00e5bbb9e6c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:12.565546 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2aeaa6a6-f0f6-4a83-9a45-e00e5bbb9e6c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:12.573650 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2aeaa6a6-f0f6-4a83-9a45-e00e5bbb9e6c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.574138 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2aeaa6a6-f0f6-4a83-9a45-e00e5bbb9e6c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.574564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2aeaa6a6-f0f6-4a83-9a45-e00e5bbb9e6c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:12.575256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2aeaa6a6-f0f6-4a83-9a45-e00e5bbb9e6c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.575704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2aeaa6a6-f0f6-4a83-9a45-e00e5bbb9e6c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.576122 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2aeaa6a6-f0f6-4a83-9a45-e00e5bbb9e6c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:12.730757 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2aeaa6a6-f0f6-4a83-9a45-e00e5bbb9e6c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:12.745004 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2aeaa6a6-f0f6-4a83-9a45-e00e5bbb9e6c tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1502 microversion: 2.1 time: 0.183799 Sep 06 16:17:12.745985 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 125/250] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:12 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:12.881488 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d3413089-7442-40c7-917d-78fef8048553 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:12.882142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d3413089-7442-40c7-917d-78fef8048553 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:12.889058 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d3413089-7442-40c7-917d-78fef8048553 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.889544 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d3413089-7442-40c7-917d-78fef8048553 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.889970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d3413089-7442-40c7-917d-78fef8048553 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:12.890670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d3413089-7442-40c7-917d-78fef8048553 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.891131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d3413089-7442-40c7-917d-78fef8048553 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.891537 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d3413089-7442-40c7-917d-78fef8048553 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.002728 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-89389892-ebbd-4c58-861e-c29784342f2d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:13.002728 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-89389892-ebbd-4c58-861e-c29784342f2d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:13.006528 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89389892-ebbd-4c58-861e-c29784342f2d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.006924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89389892-ebbd-4c58-861e-c29784342f2d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.007465 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89389892-ebbd-4c58-861e-c29784342f2d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.008261 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89389892-ebbd-4c58-861e-c29784342f2d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.008823 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89389892-ebbd-4c58-861e-c29784342f2d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.009379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89389892-ebbd-4c58-861e-c29784342f2d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.114232 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d3413089-7442-40c7-917d-78fef8048553 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:13.144828 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d3413089-7442-40c7-917d-78fef8048553 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:13.144828 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d3413089-7442-40c7-917d-78fef8048553 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:13.144828 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d3413089-7442-40c7-917d-78fef8048553 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1407 microversion: 2.20 time: 0.266751 Sep 06 16:17:13.158672 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 126/251] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:17:12 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:17:13.298624 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-89389892-ebbd-4c58-861e-c29784342f2d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:13.308483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-89389892-ebbd-4c58-861e-c29784342f2d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.314230 Sep 06 16:17:13.321190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 126/252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:12 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:13.522782 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f1bcf7e6-8b18-43e7-b981-bcb1c835bcc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:13.523423 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f1bcf7e6-8b18-43e7-b981-bcb1c835bcc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:13.529923 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f1bcf7e6-8b18-43e7-b981-bcb1c835bcc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.530424 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f1bcf7e6-8b18-43e7-b981-bcb1c835bcc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.530844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f1bcf7e6-8b18-43e7-b981-bcb1c835bcc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.531544 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f1bcf7e6-8b18-43e7-b981-bcb1c835bcc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.532038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f1bcf7e6-8b18-43e7-b981-bcb1c835bcc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.532410 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f1bcf7e6-8b18-43e7-b981-bcb1c835bcc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.664974 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f1bcf7e6-8b18-43e7-b981-bcb1c835bcc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:13.673148 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f1bcf7e6-8b18-43e7-b981-bcb1c835bcc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.154397 Sep 06 16:17:13.673726 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 127/253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:13 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:14.173432 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-de34c3d8-5cad-443c-8072-14682449d6db tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:14.174035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-de34c3d8-5cad-443c-8072-14682449d6db tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:14.181700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-de34c3d8-5cad-443c-8072-14682449d6db tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.182236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-de34c3d8-5cad-443c-8072-14682449d6db tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.182789 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-de34c3d8-5cad-443c-8072-14682449d6db tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:14.183566 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-de34c3d8-5cad-443c-8072-14682449d6db tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.184146 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-de34c3d8-5cad-443c-8072-14682449d6db tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.184829 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-de34c3d8-5cad-443c-8072-14682449d6db tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:14.332141 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-854f0640-b269-4c5c-acef-a2bc3166cdc8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:14.332606 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-de34c3d8-5cad-443c-8072-14682449d6db tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:14.332743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-854f0640-b269-4c5c-acef-a2bc3166cdc8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:14.338911 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-854f0640-b269-4c5c-acef-a2bc3166cdc8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.339384 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-854f0640-b269-4c5c-acef-a2bc3166cdc8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.339808 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-854f0640-b269-4c5c-acef-a2bc3166cdc8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:14.340492 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-854f0640-b269-4c5c-acef-a2bc3166cdc8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.340879 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-de34c3d8-5cad-443c-8072-14682449d6db tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:14.340992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-854f0640-b269-4c5c-acef-a2bc3166cdc8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.341367 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-854f0640-b269-4c5c-acef-a2bc3166cdc8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:14.342311 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-de34c3d8-5cad-443c-8072-14682449d6db tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:14.343474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-de34c3d8-5cad-443c-8072-14682449d6db tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1598 microversion: 2.20 time: 0.175580 Sep 06 16:17:14.344031 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 127/254] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:17:14 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:17:14.369574 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c3417bf8-73c3-4498-a77d-f724b5763c3c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:14.370063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c3417bf8-73c3-4498-a77d-f724b5763c3c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:14.377043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c3417bf8-73c3-4498-a77d-f724b5763c3c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.377525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c3417bf8-73c3-4498-a77d-f724b5763c3c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.377945 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c3417bf8-73c3-4498-a77d-f724b5763c3c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:14.378640 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c3417bf8-73c3-4498-a77d-f724b5763c3c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.379116 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c3417bf8-73c3-4498-a77d-f724b5763c3c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.379667 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c3417bf8-73c3-4498-a77d-f724b5763c3c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:14.503192 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-854f0640-b269-4c5c-acef-a2bc3166cdc8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:14.512305 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-854f0640-b269-4c5c-acef-a2bc3166cdc8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.183866 Sep 06 16:17:14.513226 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c3417bf8-73c3-4498-a77d-f724b5763c3c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.147642 Sep 06 16:17:14.513460 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 128/255] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:14 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:14.518037 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 128/256] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Sep 6 16:17:14 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 16:17:14.696266 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ecaa50bd-e581-45fa-9b27-81cafa4a81c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:14.696874 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ecaa50bd-e581-45fa-9b27-81cafa4a81c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:14.703324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ecaa50bd-e581-45fa-9b27-81cafa4a81c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.703787 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ecaa50bd-e581-45fa-9b27-81cafa4a81c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.704546 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ecaa50bd-e581-45fa-9b27-81cafa4a81c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:14.705290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ecaa50bd-e581-45fa-9b27-81cafa4a81c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.705737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ecaa50bd-e581-45fa-9b27-81cafa4a81c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.706151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ecaa50bd-e581-45fa-9b27-81cafa4a81c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:15.006355 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ecaa50bd-e581-45fa-9b27-81cafa4a81c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:15.014745 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ecaa50bd-e581-45fa-9b27-81cafa4a81c6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.322677 Sep 06 16:17:15.015350 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 129/257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:14 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:15.536200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-77322681-41b7-4202-8680-17e335c4ee88 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:15.537075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-77322681-41b7-4202-8680-17e335c4ee88 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:15.539440 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=99 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:15.547275 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77322681-41b7-4202-8680-17e335c4ee88 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:15.548089 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77322681-41b7-4202-8680-17e335c4ee88 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:15.548727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77322681-41b7-4202-8680-17e335c4ee88 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:15.549967 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77322681-41b7-4202-8680-17e335c4ee88 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:15.550520 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77322681-41b7-4202-8680-17e335c4ee88 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:15.551301 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77322681-41b7-4202-8680-17e335c4ee88 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:15.710498 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-77322681-41b7-4202-8680-17e335c4ee88 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:15.718478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-77322681-41b7-4202-8680-17e335c4ee88 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.186482 Sep 06 16:17:15.719054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 129/258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:15 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:15.966737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-d31c1775-0fcf-4aa1-939d-5406db429c80 req-ea7221dd-0a33-4ad0-aa2e-0f8a8d8cf486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2", "tag": "4b0a3d0f-c85a-40a8-b906-23e0735edd5e"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:15.977322 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-d31c1775-0fcf-4aa1-939d-5406db429c80 req-ea7221dd-0a33-4ad0-aa2e-0f8a8d8cf486 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:15.977804 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-d31c1775-0fcf-4aa1-939d-5406db429c80 req-ea7221dd-0a33-4ad0-aa2e-0f8a8d8cf486 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:15.978252 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-d31c1775-0fcf-4aa1-939d-5406db429c80 req-ea7221dd-0a33-4ad0-aa2e-0f8a8d8cf486 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:15.991554 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-d31c1775-0fcf-4aa1-939d-5406db429c80 req-ea7221dd-0a33-4ad0-aa2e-0f8a8d8cf486 service nova] Creating event network-changed:4b0a3d0f-c85a-40a8-b906-23e0735edd5e for instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 on hv-cinder-85221 Sep 06 16:17:15.997042 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-d31c1775-0fcf-4aa1-939d-5406db429c80 req-ea7221dd-0a33-4ad0-aa2e-0f8a8d8cf486 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034207 Sep 06 16:17:15.997712 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 130/259] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:16.040444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-bd7c7781-b404-4a69-b002-fcb80154146c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:16.041319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-bd7c7781-b404-4a69-b002-fcb80154146c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:16.047970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd7c7781-b404-4a69-b002-fcb80154146c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:16.048473 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd7c7781-b404-4a69-b002-fcb80154146c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:16.048976 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd7c7781-b404-4a69-b002-fcb80154146c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:16.049855 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd7c7781-b404-4a69-b002-fcb80154146c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:16.050308 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd7c7781-b404-4a69-b002-fcb80154146c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:16.050761 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd7c7781-b404-4a69-b002-fcb80154146c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:16.192253 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-bd7c7781-b404-4a69-b002-fcb80154146c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:16.200641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-bd7c7781-b404-4a69-b002-fcb80154146c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.164322 Sep 06 16:17:16.201281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 130/260] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:16 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:16.742880 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1251fa5a-2b32-4238-926b-7c7dd1f606a9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:16.743678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1251fa5a-2b32-4238-926b-7c7dd1f606a9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:16.750832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1251fa5a-2b32-4238-926b-7c7dd1f606a9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:16.751386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1251fa5a-2b32-4238-926b-7c7dd1f606a9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:16.751833 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1251fa5a-2b32-4238-926b-7c7dd1f606a9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:16.752606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1251fa5a-2b32-4238-926b-7c7dd1f606a9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:16.753103 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1251fa5a-2b32-4238-926b-7c7dd1f606a9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:16.753529 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1251fa5a-2b32-4238-926b-7c7dd1f606a9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:16.907706 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1251fa5a-2b32-4238-926b-7c7dd1f606a9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:16.916285 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1251fa5a-2b32-4238-926b-7c7dd1f606a9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.178312 Sep 06 16:17:16.917113 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 131/261] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:16 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:17.224237 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c8b22497-1c20-4220-a8e3-1e5d4fcfeaa6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:17.224822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c8b22497-1c20-4220-a8e3-1e5d4fcfeaa6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:17.231347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c8b22497-1c20-4220-a8e3-1e5d4fcfeaa6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:17.231860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c8b22497-1c20-4220-a8e3-1e5d4fcfeaa6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:17.232294 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c8b22497-1c20-4220-a8e3-1e5d4fcfeaa6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:17.233046 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c8b22497-1c20-4220-a8e3-1e5d4fcfeaa6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:17.233494 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c8b22497-1c20-4220-a8e3-1e5d4fcfeaa6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:17.233916 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c8b22497-1c20-4220-a8e3-1e5d4fcfeaa6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:17.404202 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c8b22497-1c20-4220-a8e3-1e5d4fcfeaa6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:17.417012 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c8b22497-1c20-4220-a8e3-1e5d4fcfeaa6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.196276 Sep 06 16:17:17.418268 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 131/262] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:17 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:17.940440 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ac0aa68b-9259-484c-8d32-c557195dec71 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:17.941072 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ac0aa68b-9259-484c-8d32-c557195dec71 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:17.948037 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac0aa68b-9259-484c-8d32-c557195dec71 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:17.948642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac0aa68b-9259-484c-8d32-c557195dec71 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:17.949241 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac0aa68b-9259-484c-8d32-c557195dec71 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:17.950032 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac0aa68b-9259-484c-8d32-c557195dec71 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:17.950489 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac0aa68b-9259-484c-8d32-c557195dec71 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:17.951019 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac0aa68b-9259-484c-8d32-c557195dec71 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:18.101781 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ac0aa68b-9259-484c-8d32-c557195dec71 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:18.109928 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ac0aa68b-9259-484c-8d32-c557195dec71 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.173837 Sep 06 16:17:18.110522 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 132/263] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:17 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:18.443595 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6b23a79d-64cb-4867-a6f3-a0385755680b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:18.444200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6b23a79d-64cb-4867-a6f3-a0385755680b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:18.451347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6b23a79d-64cb-4867-a6f3-a0385755680b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:18.452008 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6b23a79d-64cb-4867-a6f3-a0385755680b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:18.452673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6b23a79d-64cb-4867-a6f3-a0385755680b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:18.453653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6b23a79d-64cb-4867-a6f3-a0385755680b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:18.454472 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6b23a79d-64cb-4867-a6f3-a0385755680b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:18.455236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6b23a79d-64cb-4867-a6f3-a0385755680b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:18.614513 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6b23a79d-64cb-4867-a6f3-a0385755680b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:18.624640 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6b23a79d-64cb-4867-a6f3-a0385755680b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.184721 Sep 06 16:17:18.625263 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 132/264] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:18 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:18.775563 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cd7077f8-e4ae-4c47-ba60-958e659b41ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d80fbf2-583e-48fc-861b-572d95668596"}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:18.778317 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cd7077f8-e4ae-4c47-ba60-958e659b41ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:18.785950 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd7077f8-e4ae-4c47-ba60-958e659b41ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:18.786610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd7077f8-e4ae-4c47-ba60-958e659b41ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:18.787051 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd7077f8-e4ae-4c47-ba60-958e659b41ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:18.787986 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd7077f8-e4ae-4c47-ba60-958e659b41ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:18.788438 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd7077f8-e4ae-4c47-ba60-958e659b41ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:18.788887 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd7077f8-e4ae-4c47-ba60-958e659b41ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:19.133748 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d4ffddef-2620-4fec-b5dc-b476cd0a8716 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:19.134358 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d4ffddef-2620-4fec-b5dc-b476cd0a8716 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:19.141111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4ffddef-2620-4fec-b5dc-b476cd0a8716 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:19.141846 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4ffddef-2620-4fec-b5dc-b476cd0a8716 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:19.142479 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4ffddef-2620-4fec-b5dc-b476cd0a8716 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:19.143552 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4ffddef-2620-4fec-b5dc-b476cd0a8716 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:19.144279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4ffddef-2620-4fec-b5dc-b476cd0a8716 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:19.144695 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4ffddef-2620-4fec-b5dc-b476cd0a8716 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:19.327362 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d4ffddef-2620-4fec-b5dc-b476cd0a8716 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:19.336259 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d4ffddef-2620-4fec-b5dc-b476cd0a8716 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.206462 Sep 06 16:17:19.337198 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 133/265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:19 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:19.647911 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f1a5a808-bec8-480d-8040-f29ea03b8fbf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:19.648679 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f1a5a808-bec8-480d-8040-f29ea03b8fbf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:19.655559 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f1a5a808-bec8-480d-8040-f29ea03b8fbf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:19.656043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f1a5a808-bec8-480d-8040-f29ea03b8fbf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:19.656467 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f1a5a808-bec8-480d-8040-f29ea03b8fbf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:19.657297 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f1a5a808-bec8-480d-8040-f29ea03b8fbf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:19.657764 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f1a5a808-bec8-480d-8040-f29ea03b8fbf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:19.658275 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f1a5a808-bec8-480d-8040-f29ea03b8fbf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:19.829551 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f1a5a808-bec8-480d-8040-f29ea03b8fbf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:19.839766 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f1a5a808-bec8-480d-8040-f29ea03b8fbf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.195759 Sep 06 16:17:19.840466 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 134/266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:19 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:20.359296 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-8a96563a-dcfc-4adb-9467-3dbe43f40247 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:20.359908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-8a96563a-dcfc-4adb-9467-3dbe43f40247 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:20.366099 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8a96563a-dcfc-4adb-9467-3dbe43f40247 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:20.366591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8a96563a-dcfc-4adb-9467-3dbe43f40247 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:20.367026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8a96563a-dcfc-4adb-9467-3dbe43f40247 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:20.367711 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8a96563a-dcfc-4adb-9467-3dbe43f40247 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:20.368162 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8a96563a-dcfc-4adb-9467-3dbe43f40247 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:20.368583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8a96563a-dcfc-4adb-9467-3dbe43f40247 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:20.503712 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8a96563a-dcfc-4adb-9467-3dbe43f40247 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:20.512537 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-8a96563a-dcfc-4adb-9467-3dbe43f40247 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.156947 Sep 06 16:17:20.513384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 135/267] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:20 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:20.863372 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2bac33e2-65ca-4bb8-9160-58eff8f8f149 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:20.864079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2bac33e2-65ca-4bb8-9160-58eff8f8f149 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:20.870378 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2bac33e2-65ca-4bb8-9160-58eff8f8f149 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:20.870860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2bac33e2-65ca-4bb8-9160-58eff8f8f149 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:20.871294 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2bac33e2-65ca-4bb8-9160-58eff8f8f149 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:20.871969 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2bac33e2-65ca-4bb8-9160-58eff8f8f149 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:20.872421 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2bac33e2-65ca-4bb8-9160-58eff8f8f149 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:20.873077 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2bac33e2-65ca-4bb8-9160-58eff8f8f149 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:20.877049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:21.015043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2bac33e2-65ca-4bb8-9160-58eff8f8f149 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:21.022603 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2bac33e2-65ca-4bb8-9160-58eff8f8f149 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.163624 Sep 06 16:17:21.023178 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 136/268] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:20 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:21.535591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-cec070ff-bd7e-4814-9b26-de47118aec35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:21.536188 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-cec070ff-bd7e-4814-9b26-de47118aec35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:21.542171 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cec070ff-bd7e-4814-9b26-de47118aec35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:21.542631 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cec070ff-bd7e-4814-9b26-de47118aec35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:21.543049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cec070ff-bd7e-4814-9b26-de47118aec35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:21.543729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cec070ff-bd7e-4814-9b26-de47118aec35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:21.544165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cec070ff-bd7e-4814-9b26-de47118aec35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:21.544741 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cec070ff-bd7e-4814-9b26-de47118aec35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:21.683306 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cec070ff-bd7e-4814-9b26-de47118aec35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:21.691636 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-cec070ff-bd7e-4814-9b26-de47118aec35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.159811 Sep 06 16:17:21.692245 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 137/269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:21 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:22.045442 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c84299bc-12d9-4dcc-a7c1-45b97ffbf01d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:22.046057 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c84299bc-12d9-4dcc-a7c1-45b97ffbf01d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:22.053104 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c84299bc-12d9-4dcc-a7c1-45b97ffbf01d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:22.053611 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c84299bc-12d9-4dcc-a7c1-45b97ffbf01d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:22.054025 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c84299bc-12d9-4dcc-a7c1-45b97ffbf01d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:22.054721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c84299bc-12d9-4dcc-a7c1-45b97ffbf01d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:22.055171 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c84299bc-12d9-4dcc-a7c1-45b97ffbf01d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:22.055631 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c84299bc-12d9-4dcc-a7c1-45b97ffbf01d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:22.206591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c84299bc-12d9-4dcc-a7c1-45b97ffbf01d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:22.215709 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c84299bc-12d9-4dcc-a7c1-45b97ffbf01d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.174122 Sep 06 16:17:22.216530 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 138/270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:22 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:22.715475 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-09852c73-e8e0-4de1-88d0-a2a155a203f8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:22.716156 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-09852c73-e8e0-4de1-88d0-a2a155a203f8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:22.722496 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-09852c73-e8e0-4de1-88d0-a2a155a203f8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:22.722962 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-09852c73-e8e0-4de1-88d0-a2a155a203f8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:22.723430 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-09852c73-e8e0-4de1-88d0-a2a155a203f8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:22.724098 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-09852c73-e8e0-4de1-88d0-a2a155a203f8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:22.724540 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-09852c73-e8e0-4de1-88d0-a2a155a203f8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:22.724980 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-09852c73-e8e0-4de1-88d0-a2a155a203f8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:22.880894 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-09852c73-e8e0-4de1-88d0-a2a155a203f8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:22.888576 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-09852c73-e8e0-4de1-88d0-a2a155a203f8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.176973 Sep 06 16:17:22.889482 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 139/271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:22 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:23.238768 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-febbff28-bc67-4b5a-b2c4-120768683bab tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:23.239407 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-febbff28-bc67-4b5a-b2c4-120768683bab tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:23.248785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-febbff28-bc67-4b5a-b2c4-120768683bab tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:23.249319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-febbff28-bc67-4b5a-b2c4-120768683bab tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:23.249774 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-febbff28-bc67-4b5a-b2c4-120768683bab tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:23.250495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-febbff28-bc67-4b5a-b2c4-120768683bab tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:23.250937 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-febbff28-bc67-4b5a-b2c4-120768683bab tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:23.251348 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-febbff28-bc67-4b5a-b2c4-120768683bab tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:23.436392 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-febbff28-bc67-4b5a-b2c4-120768683bab tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:23.447922 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-febbff28-bc67-4b5a-b2c4-120768683bab tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.213109 Sep 06 16:17:23.448520 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 140/272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:23 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:23.912646 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-987652a1-181e-443d-8d53-4cba9c3fd8d6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:23.913271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-987652a1-181e-443d-8d53-4cba9c3fd8d6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:23.922278 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-987652a1-181e-443d-8d53-4cba9c3fd8d6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:23.922768 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-987652a1-181e-443d-8d53-4cba9c3fd8d6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:23.923366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-987652a1-181e-443d-8d53-4cba9c3fd8d6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:23.924243 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-987652a1-181e-443d-8d53-4cba9c3fd8d6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:23.925018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-987652a1-181e-443d-8d53-4cba9c3fd8d6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:23.925442 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-987652a1-181e-443d-8d53-4cba9c3fd8d6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:24.094174 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-987652a1-181e-443d-8d53-4cba9c3fd8d6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:24.102660 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-987652a1-181e-443d-8d53-4cba9c3fd8d6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.193825 Sep 06 16:17:24.103176 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 141/273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:23 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:24.476738 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9b8097a8-1a03-473c-828e-4c116da6021e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:24.477586 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9b8097a8-1a03-473c-828e-4c116da6021e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:24.485913 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b8097a8-1a03-473c-828e-4c116da6021e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:24.486321 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b8097a8-1a03-473c-828e-4c116da6021e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:24.486473 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b8097a8-1a03-473c-828e-4c116da6021e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:24.487248 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b8097a8-1a03-473c-828e-4c116da6021e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:24.487577 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b8097a8-1a03-473c-828e-4c116da6021e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:24.488073 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b8097a8-1a03-473c-828e-4c116da6021e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:24.630710 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9b8097a8-1a03-473c-828e-4c116da6021e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:24.642953 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9b8097a8-1a03-473c-828e-4c116da6021e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.172181 Sep 06 16:17:24.643799 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 142/274] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:24 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:25.132228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-53d55029-9f2f-42f0-ba59-0b4134f45a43 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:25.132906 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-53d55029-9f2f-42f0-ba59-0b4134f45a43 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:25.139807 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-53d55029-9f2f-42f0-ba59-0b4134f45a43 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:25.140323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-53d55029-9f2f-42f0-ba59-0b4134f45a43 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:25.140925 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-53d55029-9f2f-42f0-ba59-0b4134f45a43 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:25.141676 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-53d55029-9f2f-42f0-ba59-0b4134f45a43 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:25.142460 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-53d55029-9f2f-42f0-ba59-0b4134f45a43 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:25.142884 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-53d55029-9f2f-42f0-ba59-0b4134f45a43 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:25.341640 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-53d55029-9f2f-42f0-ba59-0b4134f45a43 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:25.351165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-53d55029-9f2f-42f0-ba59-0b4134f45a43 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.224540 Sep 06 16:17:25.352194 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 143/275] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:25 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:25.668679 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-bf56e0bf-0b7e-4e36-91fc-69965a6d2116 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:25.669718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-bf56e0bf-0b7e-4e36-91fc-69965a6d2116 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:25.676519 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bf56e0bf-0b7e-4e36-91fc-69965a6d2116 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:25.677063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bf56e0bf-0b7e-4e36-91fc-69965a6d2116 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:25.678387 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bf56e0bf-0b7e-4e36-91fc-69965a6d2116 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:25.679649 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bf56e0bf-0b7e-4e36-91fc-69965a6d2116 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:25.680122 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bf56e0bf-0b7e-4e36-91fc-69965a6d2116 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:25.680549 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bf56e0bf-0b7e-4e36-91fc-69965a6d2116 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:25.851501 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-bf56e0bf-0b7e-4e36-91fc-69965a6d2116 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:25.859956 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-bf56e0bf-0b7e-4e36-91fc-69965a6d2116 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.196987 Sep 06 16:17:25.873117 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 144/276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:25 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:26.378663 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d3571d00-5872-48b3-933b-e668a09988cf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:26.379528 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d3571d00-5872-48b3-933b-e668a09988cf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:26.389846 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d3571d00-5872-48b3-933b-e668a09988cf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:26.390897 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d3571d00-5872-48b3-933b-e668a09988cf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:26.391846 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d3571d00-5872-48b3-933b-e668a09988cf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:26.392978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d3571d00-5872-48b3-933b-e668a09988cf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:26.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d3571d00-5872-48b3-933b-e668a09988cf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:26.398981 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d3571d00-5872-48b3-933b-e668a09988cf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:26.533603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cd7077f8-e4ae-4c47-ba60-958e659b41ee tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "POST /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.761087 Sep 06 16:17:26.536488 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 133/277] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:17:18 2022] POST /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4/os-volume_attachments => generated 194 bytes in 7766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:26.698403 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d3571d00-5872-48b3-933b-e668a09988cf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:26.708885 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d3571d00-5872-48b3-933b-e668a09988cf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.337754 Sep 06 16:17:26.710010 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 145/278] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:26 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:26.889168 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3a2cd0f8-3a54-49ca-8b3d-ebb5dc170e2c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:26.890356 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-3a2cd0f8-3a54-49ca-8b3d-ebb5dc170e2c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:26.894073 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=82 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:26.903933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3a2cd0f8-3a54-49ca-8b3d-ebb5dc170e2c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:26.904986 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3a2cd0f8-3a54-49ca-8b3d-ebb5dc170e2c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:26.905830 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3a2cd0f8-3a54-49ca-8b3d-ebb5dc170e2c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:26.907313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3a2cd0f8-3a54-49ca-8b3d-ebb5dc170e2c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:26.908119 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3a2cd0f8-3a54-49ca-8b3d-ebb5dc170e2c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:26.909085 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3a2cd0f8-3a54-49ca-8b3d-ebb5dc170e2c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:27.104075 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3a2cd0f8-3a54-49ca-8b3d-ebb5dc170e2c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:27.113155 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-3a2cd0f8-3a54-49ca-8b3d-ebb5dc170e2c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.231777 Sep 06 16:17:27.125508 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 134/279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:26 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:27.736618 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-601493b2-c3ec-4633-af38-f1d4315b100a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:27.737415 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-601493b2-c3ec-4633-af38-f1d4315b100a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:27.756218 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-601493b2-c3ec-4633-af38-f1d4315b100a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:27.757110 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-601493b2-c3ec-4633-af38-f1d4315b100a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:27.759173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-601493b2-c3ec-4633-af38-f1d4315b100a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:27.765134 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-601493b2-c3ec-4633-af38-f1d4315b100a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:27.766895 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-601493b2-c3ec-4633-af38-f1d4315b100a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:27.769339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-601493b2-c3ec-4633-af38-f1d4315b100a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:28.121935 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-601493b2-c3ec-4633-af38-f1d4315b100a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:28.141386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-21d1944b-d910-419c-8e7f-635b25e06218 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:28.142255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-21d1944b-d910-419c-8e7f-635b25e06218 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:28.147556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-601493b2-c3ec-4633-af38-f1d4315b100a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1363 microversion: 2.1 time: 0.415155 Sep 06 16:17:28.149079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 146/280] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:27 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1363 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:28.178325 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-21d1944b-d910-419c-8e7f-635b25e06218 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:28.178818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-21d1944b-d910-419c-8e7f-635b25e06218 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:28.179290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-21d1944b-d910-419c-8e7f-635b25e06218 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:28.180468 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-21d1944b-d910-419c-8e7f-635b25e06218 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:28.181063 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-21d1944b-d910-419c-8e7f-635b25e06218 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:28.181481 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-21d1944b-d910-419c-8e7f-635b25e06218 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:28.410776 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-21d1944b-d910-419c-8e7f-635b25e06218 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:28.421218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-21d1944b-d910-419c-8e7f-635b25e06218 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.288624 Sep 06 16:17:28.422495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 135/281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:28 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:29.183351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1d2d4c4d-3ba6-4d64-b095-a141dcfd15ed tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:29.184591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1d2d4c4d-3ba6-4d64-b095-a141dcfd15ed tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:29.191642 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d2d4c4d-3ba6-4d64-b095-a141dcfd15ed tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:29.192159 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d2d4c4d-3ba6-4d64-b095-a141dcfd15ed tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:29.192588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d2d4c4d-3ba6-4d64-b095-a141dcfd15ed tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:29.193517 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d2d4c4d-3ba6-4d64-b095-a141dcfd15ed tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:29.193931 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d2d4c4d-3ba6-4d64-b095-a141dcfd15ed tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:29.194565 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d2d4c4d-3ba6-4d64-b095-a141dcfd15ed tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:29.340555 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1d2d4c4d-3ba6-4d64-b095-a141dcfd15ed tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:29.349924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1d2d4c4d-3ba6-4d64-b095-a141dcfd15ed tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1550 microversion: 2.1 time: 0.170334 Sep 06 16:17:29.365136 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 147/282] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:29 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1550 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:29.375799 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-03b52587-605b-4031-a5e8-1713ebcd8ab2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:29.377056 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-03b52587-605b-4031-a5e8-1713ebcd8ab2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:29.383822 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-03b52587-605b-4031-a5e8-1713ebcd8ab2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:29.384522 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-03b52587-605b-4031-a5e8-1713ebcd8ab2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:29.385112 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-03b52587-605b-4031-a5e8-1713ebcd8ab2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:29.385982 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-03b52587-605b-4031-a5e8-1713ebcd8ab2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:29.386569 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-03b52587-605b-4031-a5e8-1713ebcd8ab2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:29.387123 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-03b52587-605b-4031-a5e8-1713ebcd8ab2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:29.449160 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ccb2e09f-dd27-4d1e-93f6-94272486f0d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:29.449694 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ccb2e09f-dd27-4d1e-93f6-94272486f0d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:29.458465 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ccb2e09f-dd27-4d1e-93f6-94272486f0d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:29.459566 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ccb2e09f-dd27-4d1e-93f6-94272486f0d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:29.460209 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ccb2e09f-dd27-4d1e-93f6-94272486f0d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:29.461105 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ccb2e09f-dd27-4d1e-93f6-94272486f0d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:29.461827 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ccb2e09f-dd27-4d1e-93f6-94272486f0d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:29.462444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ccb2e09f-dd27-4d1e-93f6-94272486f0d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:29.508203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-03b52587-605b-4031-a5e8-1713ebcd8ab2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136200 Sep 06 16:17:29.509187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 136/283] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 6 16:17:29 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:29.647923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ccb2e09f-dd27-4d1e-93f6-94272486f0d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:29.659199 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ccb2e09f-dd27-4d1e-93f6-94272486f0d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.217230 Sep 06 16:17:29.670572 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 148/284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:29 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:29.970938 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-3b2ca893-57ca-4c0e-8f4a-a4af62f29dbc req-bb336fd2-f5ad-4818-b2b3-f176bdf6b6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0088f479-7a4c-4bf2-909d-f7caf1795be8", "name": "network-vif-plugged", "status": "completed", "tag": "9b788b0b-0011-463e-88c6-ea88f1a5652f"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:29.991425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-3b2ca893-57ca-4c0e-8f4a-a4af62f29dbc req-bb336fd2-f5ad-4818-b2b3-f176bdf6b6f5 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:29.994787 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-3b2ca893-57ca-4c0e-8f4a-a4af62f29dbc req-bb336fd2-f5ad-4818-b2b3-f176bdf6b6f5 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:29.995302 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-3b2ca893-57ca-4c0e-8f4a-a4af62f29dbc req-bb336fd2-f5ad-4818-b2b3-f176bdf6b6f5 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:30.033900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-3b2ca893-57ca-4c0e-8f4a-a4af62f29dbc req-bb336fd2-f5ad-4818-b2b3-f176bdf6b6f5 service nova] Creating event network-vif-plugged:9b788b0b-0011-463e-88c6-ea88f1a5652f for instance 0088f479-7a4c-4bf2-909d-f7caf1795be8 on hv-cinder-85221 Sep 06 16:17:30.047116 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-3b2ca893-57ca-4c0e-8f4a-a4af62f29dbc req-bb336fd2-f5ad-4818-b2b3-f176bdf6b6f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080423 Sep 06 16:17:30.047867 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 137/285] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:30.685881 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-46ee4703-b577-4442-b17e-a294e80de3e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:30.687772 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-46ee4703-b577-4442-b17e-a294e80de3e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:30.698966 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-46ee4703-b577-4442-b17e-a294e80de3e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:30.699822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-46ee4703-b577-4442-b17e-a294e80de3e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:30.700613 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-46ee4703-b577-4442-b17e-a294e80de3e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:30.701662 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-46ee4703-b577-4442-b17e-a294e80de3e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:30.702473 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-46ee4703-b577-4442-b17e-a294e80de3e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:30.703110 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-46ee4703-b577-4442-b17e-a294e80de3e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:30.876137 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-46ee4703-b577-4442-b17e-a294e80de3e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:30.888079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-46ee4703-b577-4442-b17e-a294e80de3e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.208164 Sep 06 16:17:30.889255 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 149/286] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:30 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:31.179730 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-d49b5460-41ff-4a51-9a8f-49fbfdcb9ce5 req-e5db4048-7da5-4c93-8d6b-48c22b62102b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc140df-902e-4875-822f-53831e91b1c3", "tag": "42ae6570-50c2-4446-95be-d0b723ac181e"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:31.194233 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-d49b5460-41ff-4a51-9a8f-49fbfdcb9ce5 req-e5db4048-7da5-4c93-8d6b-48c22b62102b service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:31.194974 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-d49b5460-41ff-4a51-9a8f-49fbfdcb9ce5 req-e5db4048-7da5-4c93-8d6b-48c22b62102b service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:31.195612 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-d49b5460-41ff-4a51-9a8f-49fbfdcb9ce5 req-e5db4048-7da5-4c93-8d6b-48c22b62102b service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:31.213293 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-d49b5460-41ff-4a51-9a8f-49fbfdcb9ce5 req-e5db4048-7da5-4c93-8d6b-48c22b62102b service nova] Creating event network-changed:42ae6570-50c2-4446-95be-d0b723ac181e for instance dbc140df-902e-4875-822f-53831e91b1c3 on hv-cinder-85221 Sep 06 16:17:31.220472 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-d49b5460-41ff-4a51-9a8f-49fbfdcb9ce5 req-e5db4048-7da5-4c93-8d6b-48c22b62102b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045582 Sep 06 16:17:31.221424 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 138/287] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:31.913205 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2a2f4e5b-aedb-4492-a9f0-a5a812c5a41e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:31.915063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2a2f4e5b-aedb-4492-a9f0-a5a812c5a41e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:31.927113 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2a2f4e5b-aedb-4492-a9f0-a5a812c5a41e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:31.927657 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2a2f4e5b-aedb-4492-a9f0-a5a812c5a41e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:31.928101 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2a2f4e5b-aedb-4492-a9f0-a5a812c5a41e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:31.928871 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2a2f4e5b-aedb-4492-a9f0-a5a812c5a41e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:31.929623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2a2f4e5b-aedb-4492-a9f0-a5a812c5a41e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:31.930398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2a2f4e5b-aedb-4492-a9f0-a5a812c5a41e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:32.265280 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2a2f4e5b-aedb-4492-a9f0-a5a812c5a41e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:32.277845 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2a2f4e5b-aedb-4492-a9f0-a5a812c5a41e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1322 microversion: 2.1 time: 0.369376 Sep 06 16:17:32.289548 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 150/288] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:31 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:33.319846 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8a83c588-2a2f-4b21-8217-d79752a85b2d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:33.325283 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8a83c588-2a2f-4b21-8217-d79752a85b2d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:33.351704 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8a83c588-2a2f-4b21-8217-d79752a85b2d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:33.352706 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8a83c588-2a2f-4b21-8217-d79752a85b2d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:33.353542 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8a83c588-2a2f-4b21-8217-d79752a85b2d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:33.354815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8a83c588-2a2f-4b21-8217-d79752a85b2d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:33.355683 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8a83c588-2a2f-4b21-8217-d79752a85b2d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:33.356658 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8a83c588-2a2f-4b21-8217-d79752a85b2d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:33.816492 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8a83c588-2a2f-4b21-8217-d79752a85b2d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:33.826546 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:33.856325 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8a83c588-2a2f-4b21-8217-d79752a85b2d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1516 microversion: 2.1 time: 0.551036 Sep 06 16:17:33.859619 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 139/289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:33 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1516 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:33.899991 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5f851904-0d86-419e-8236-26f5dc3e8a75 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:33.902922 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5f851904-0d86-419e-8236-26f5dc3e8a75 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:33.917344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5f851904-0d86-419e-8236-26f5dc3e8a75 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:33.918444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5f851904-0d86-419e-8236-26f5dc3e8a75 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:33.918875 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5f851904-0d86-419e-8236-26f5dc3e8a75 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:33.921598 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5f851904-0d86-419e-8236-26f5dc3e8a75 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:33.922290 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5f851904-0d86-419e-8236-26f5dc3e8a75 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:33.923007 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5f851904-0d86-419e-8236-26f5dc3e8a75 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:33.969282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-5f851904-0d86-419e-8236-26f5dc3e8a75 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lazy-loading 'flavor' on Instance uuid 0088f479-7a4c-4bf2-909d-f7caf1795be8 {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:17:34.114814 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:34.200487 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5f851904-0d86-419e-8236-26f5dc3e8a75 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "POST /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8/action" status: 200 len: 32 microversion: 2.1 time: 0.305431 Sep 06 16:17:34.202427 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 151/290] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:17:33 2022] POST /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8/action => generated 32 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:17:34.216909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-837950cc-2d3c-4522-9079-d71c2cdc0258 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:34.216909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-837950cc-2d3c-4522-9079-d71c2cdc0258 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:34.220746 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-837950cc-2d3c-4522-9079-d71c2cdc0258 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:34.221275 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-837950cc-2d3c-4522-9079-d71c2cdc0258 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:34.221702 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-837950cc-2d3c-4522-9079-d71c2cdc0258 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:34.222566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-837950cc-2d3c-4522-9079-d71c2cdc0258 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:34.223514 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-837950cc-2d3c-4522-9079-d71c2cdc0258 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:34.223820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-837950cc-2d3c-4522-9079-d71c2cdc0258 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:34.378520 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-837950cc-2d3c-4522-9079-d71c2cdc0258 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:34.387444 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-837950cc-2d3c-4522-9079-d71c2cdc0258 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.179834 Sep 06 16:17:34.388373 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 140/291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:34 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:35.411475 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-00243bc4-3672-475c-becd-bfa7a9a5e3bb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:35.412188 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-00243bc4-3672-475c-becd-bfa7a9a5e3bb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:35.419686 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-00243bc4-3672-475c-becd-bfa7a9a5e3bb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:35.420181 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-00243bc4-3672-475c-becd-bfa7a9a5e3bb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:35.420607 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-00243bc4-3672-475c-becd-bfa7a9a5e3bb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:35.421345 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-00243bc4-3672-475c-becd-bfa7a9a5e3bb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:35.421767 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-00243bc4-3672-475c-becd-bfa7a9a5e3bb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:35.422217 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-00243bc4-3672-475c-becd-bfa7a9a5e3bb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:35.563882 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-00243bc4-3672-475c-becd-bfa7a9a5e3bb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:35.572348 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-00243bc4-3672-475c-becd-bfa7a9a5e3bb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.165374 Sep 06 16:17:35.572938 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 152/292] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:35 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:36.595385 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-49498336-8059-4754-a134-2a616cc3859d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:36.595972 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-49498336-8059-4754-a134-2a616cc3859d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:36.602986 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49498336-8059-4754-a134-2a616cc3859d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:36.603561 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49498336-8059-4754-a134-2a616cc3859d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:36.604015 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49498336-8059-4754-a134-2a616cc3859d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:36.604774 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49498336-8059-4754-a134-2a616cc3859d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:36.605231 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49498336-8059-4754-a134-2a616cc3859d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:36.605857 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49498336-8059-4754-a134-2a616cc3859d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:36.738391 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-49498336-8059-4754-a134-2a616cc3859d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:36.746275 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-49498336-8059-4754-a134-2a616cc3859d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.154696 Sep 06 16:17:36.747569 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 141/293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:36 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:37.769776 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d7757f4a-5b68-4c75-9e4d-c586c7bcc635 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:37.770483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d7757f4a-5b68-4c75-9e4d-c586c7bcc635 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:37.777341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7757f4a-5b68-4c75-9e4d-c586c7bcc635 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:37.777860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7757f4a-5b68-4c75-9e4d-c586c7bcc635 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:37.778337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7757f4a-5b68-4c75-9e4d-c586c7bcc635 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:37.779194 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7757f4a-5b68-4c75-9e4d-c586c7bcc635 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:37.779737 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7757f4a-5b68-4c75-9e4d-c586c7bcc635 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:37.780222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7757f4a-5b68-4c75-9e4d-c586c7bcc635 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:37.930750 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d7757f4a-5b68-4c75-9e4d-c586c7bcc635 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:37.939667 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d7757f4a-5b68-4c75-9e4d-c586c7bcc635 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.173821 Sep 06 16:17:37.940239 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 153/294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:37 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:38.330640 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6ebf61ca-2e19-4b20-b2bc-14d834eeb606 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:38.331211 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6ebf61ca-2e19-4b20-b2bc-14d834eeb606 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:38.338323 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ebf61ca-2e19-4b20-b2bc-14d834eeb606 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:38.338824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ebf61ca-2e19-4b20-b2bc-14d834eeb606 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:38.339277 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ebf61ca-2e19-4b20-b2bc-14d834eeb606 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:38.340011 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ebf61ca-2e19-4b20-b2bc-14d834eeb606 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:38.340460 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ebf61ca-2e19-4b20-b2bc-14d834eeb606 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:38.340923 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ebf61ca-2e19-4b20-b2bc-14d834eeb606 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:38.381414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6ebf61ca-2e19-4b20-b2bc-14d834eeb606 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Going to try to terminate instance {{(pid=120669) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:17:38.556984 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6ebf61ca-2e19-4b20-b2bc-14d834eeb606 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "DELETE /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 204 len: 0 microversion: 2.1 time: 0.227987 Sep 06 16:17:38.556984 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 142/295] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:17:38 2022] DELETE /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:17:38.567099 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6df83fc5-2ac7-4b02-8c25-c7ed00b72edb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:38.567807 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6df83fc5-2ac7-4b02-8c25-c7ed00b72edb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:38.574573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6df83fc5-2ac7-4b02-8c25-c7ed00b72edb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:38.575138 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6df83fc5-2ac7-4b02-8c25-c7ed00b72edb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:38.575628 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6df83fc5-2ac7-4b02-8c25-c7ed00b72edb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:38.576316 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6df83fc5-2ac7-4b02-8c25-c7ed00b72edb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:38.576842 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6df83fc5-2ac7-4b02-8c25-c7ed00b72edb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:38.577196 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6df83fc5-2ac7-4b02-8c25-c7ed00b72edb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:38.726362 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6df83fc5-2ac7-4b02-8c25-c7ed00b72edb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:38.734966 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6df83fc5-2ac7-4b02-8c25-c7ed00b72edb tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1554 microversion: 2.1 time: 0.172113 Sep 06 16:17:38.735531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 154/296] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:38 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:38.964939 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8005dc13-b24d-4749-9d50-f90910018ea9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:38.965636 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8005dc13-b24d-4749-9d50-f90910018ea9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:38.972492 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8005dc13-b24d-4749-9d50-f90910018ea9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:38.973101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8005dc13-b24d-4749-9d50-f90910018ea9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:38.973518 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8005dc13-b24d-4749-9d50-f90910018ea9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:38.974214 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8005dc13-b24d-4749-9d50-f90910018ea9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:38.974667 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8005dc13-b24d-4749-9d50-f90910018ea9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:38.975092 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8005dc13-b24d-4749-9d50-f90910018ea9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:39.125823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8005dc13-b24d-4749-9d50-f90910018ea9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:39.133671 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8005dc13-b24d-4749-9d50-f90910018ea9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.173855 Sep 06 16:17:39.134239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 143/297] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:38 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:39.758150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4dba44fa-b207-4897-8e51-9fbcf00439a9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:39.758744 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4dba44fa-b207-4897-8e51-9fbcf00439a9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:39.765238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dba44fa-b207-4897-8e51-9fbcf00439a9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:39.765715 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dba44fa-b207-4897-8e51-9fbcf00439a9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:39.766136 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dba44fa-b207-4897-8e51-9fbcf00439a9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:39.769536 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dba44fa-b207-4897-8e51-9fbcf00439a9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:39.769536 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dba44fa-b207-4897-8e51-9fbcf00439a9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:39.769536 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dba44fa-b207-4897-8e51-9fbcf00439a9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:40.048517 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4dba44fa-b207-4897-8e51-9fbcf00439a9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:40.057216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4dba44fa-b207-4897-8e51-9fbcf00439a9 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1554 microversion: 2.1 time: 0.302940 Sep 06 16:17:40.057780 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 155/298] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:39 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1554 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:40.157657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4c78339f-c751-46f9-836b-8d39e78ba510 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:40.158272 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4c78339f-c751-46f9-836b-8d39e78ba510 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:40.165067 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4c78339f-c751-46f9-836b-8d39e78ba510 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:40.165551 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4c78339f-c751-46f9-836b-8d39e78ba510 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:40.166009 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4c78339f-c751-46f9-836b-8d39e78ba510 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:40.166704 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4c78339f-c751-46f9-836b-8d39e78ba510 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:40.167154 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4c78339f-c751-46f9-836b-8d39e78ba510 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:40.167570 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4c78339f-c751-46f9-836b-8d39e78ba510 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:40.305983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4c78339f-c751-46f9-836b-8d39e78ba510 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:40.316425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4c78339f-c751-46f9-836b-8d39e78ba510 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.162344 Sep 06 16:17:40.317506 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 144/299] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:40 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:41.081257 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f8c039aa-4bac-4662-ac51-b9e8fb936a35 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:41.081847 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f8c039aa-4bac-4662-ac51-b9e8fb936a35 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:41.092099 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f8c039aa-4bac-4662-ac51-b9e8fb936a35 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:41.092604 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f8c039aa-4bac-4662-ac51-b9e8fb936a35 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:41.093457 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f8c039aa-4bac-4662-ac51-b9e8fb936a35 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:41.094642 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f8c039aa-4bac-4662-ac51-b9e8fb936a35 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:41.095259 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f8c039aa-4bac-4662-ac51-b9e8fb936a35 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:41.095978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f8c039aa-4bac-4662-ac51-b9e8fb936a35 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:41.239847 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f8c039aa-4bac-4662-ac51-b9e8fb936a35 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:41.248734 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f8c039aa-4bac-4662-ac51-b9e8fb936a35 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1554 microversion: 2.1 time: 0.171370 Sep 06 16:17:41.249330 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 156/300] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:41 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:41.362824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3c138c00-e7de-42c0-bb07-4877ab7d8b6d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:41.363494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-3c138c00-e7de-42c0-bb07-4877ab7d8b6d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:41.370402 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c138c00-e7de-42c0-bb07-4877ab7d8b6d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:41.370882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c138c00-e7de-42c0-bb07-4877ab7d8b6d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:41.371312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c138c00-e7de-42c0-bb07-4877ab7d8b6d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:41.372005 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c138c00-e7de-42c0-bb07-4877ab7d8b6d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:41.372455 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c138c00-e7de-42c0-bb07-4877ab7d8b6d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:41.372916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c138c00-e7de-42c0-bb07-4877ab7d8b6d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:41.512785 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3c138c00-e7de-42c0-bb07-4877ab7d8b6d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:41.521055 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-3c138c00-e7de-42c0-bb07-4877ab7d8b6d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.162127 Sep 06 16:17:41.521616 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 145/301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:41 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:42.273126 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4f3a64d7-c9dc-4796-a436-a3659ff13792 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:42.273899 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4f3a64d7-c9dc-4796-a436-a3659ff13792 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:42.280568 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4f3a64d7-c9dc-4796-a436-a3659ff13792 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:42.281121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4f3a64d7-c9dc-4796-a436-a3659ff13792 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:42.281583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4f3a64d7-c9dc-4796-a436-a3659ff13792 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:42.282306 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4f3a64d7-c9dc-4796-a436-a3659ff13792 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:42.282757 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4f3a64d7-c9dc-4796-a436-a3659ff13792 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:42.283182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4f3a64d7-c9dc-4796-a436-a3659ff13792 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:42.431483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4f3a64d7-c9dc-4796-a436-a3659ff13792 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:42.443976 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4f3a64d7-c9dc-4796-a436-a3659ff13792 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1554 microversion: 2.1 time: 0.174776 Sep 06 16:17:42.444947 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 157/302] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:42 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:42.546703 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6c64799a-6919-482c-801a-68732b976fc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:42.547553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6c64799a-6919-482c-801a-68732b976fc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:42.554555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6c64799a-6919-482c-801a-68732b976fc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:42.555504 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6c64799a-6919-482c-801a-68732b976fc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:42.555992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6c64799a-6919-482c-801a-68732b976fc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:42.556860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6c64799a-6919-482c-801a-68732b976fc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:42.557433 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6c64799a-6919-482c-801a-68732b976fc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:42.557981 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6c64799a-6919-482c-801a-68732b976fc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:42.741655 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6c64799a-6919-482c-801a-68732b976fc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:42.752294 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6c64799a-6919-482c-801a-68732b976fc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.210738 Sep 06 16:17:42.753277 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 146/303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:42 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:43.477187 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c346b5ea-cb3a-4c6d-8a55-7127700fd10d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:43.479397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c346b5ea-cb3a-4c6d-8a55-7127700fd10d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:43.496402 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c346b5ea-cb3a-4c6d-8a55-7127700fd10d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:43.498082 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c346b5ea-cb3a-4c6d-8a55-7127700fd10d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:43.499212 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c346b5ea-cb3a-4c6d-8a55-7127700fd10d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:43.500955 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c346b5ea-cb3a-4c6d-8a55-7127700fd10d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:43.501988 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c346b5ea-cb3a-4c6d-8a55-7127700fd10d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:43.502927 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c346b5ea-cb3a-4c6d-8a55-7127700fd10d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:43.695458 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c346b5ea-cb3a-4c6d-8a55-7127700fd10d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:43.709249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c346b5ea-cb3a-4c6d-8a55-7127700fd10d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1554 microversion: 2.1 time: 0.239028 Sep 06 16:17:43.724968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 158/304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:43 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:43.777490 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8c7e8def-fba9-45c4-8e70-2c25176b0c99 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:43.778279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8c7e8def-fba9-45c4-8e70-2c25176b0c99 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:43.786025 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8c7e8def-fba9-45c4-8e70-2c25176b0c99 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:43.786625 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8c7e8def-fba9-45c4-8e70-2c25176b0c99 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:43.787397 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8c7e8def-fba9-45c4-8e70-2c25176b0c99 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:43.788367 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8c7e8def-fba9-45c4-8e70-2c25176b0c99 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:43.789421 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8c7e8def-fba9-45c4-8e70-2c25176b0c99 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:43.790535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8c7e8def-fba9-45c4-8e70-2c25176b0c99 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:43.962755 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8c7e8def-fba9-45c4-8e70-2c25176b0c99 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:43.971095 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8c7e8def-fba9-45c4-8e70-2c25176b0c99 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.199112 Sep 06 16:17:43.971680 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 147/305] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:43 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:44.676457 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-51674cf7-6201-490d-bdff-ec5f88119fca req-aa3cb53e-58c7-4181-8b88-427c0183b8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7a8803-c332-4dde-baee-ec2049243bf4", "name": "network-vif-deleted", "tag": "c6993609-38ee-4cc3-b97f-75c88fcd8888"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:44.710672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-51674cf7-6201-490d-bdff-ec5f88119fca req-aa3cb53e-58c7-4181-8b88-427c0183b8db service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:44.711190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-51674cf7-6201-490d-bdff-ec5f88119fca req-aa3cb53e-58c7-4181-8b88-427c0183b8db service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:44.712484 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-51674cf7-6201-490d-bdff-ec5f88119fca req-aa3cb53e-58c7-4181-8b88-427c0183b8db service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:44.725020 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-51674cf7-6201-490d-bdff-ec5f88119fca req-aa3cb53e-58c7-4181-8b88-427c0183b8db service nova] Creating event network-vif-deleted:c6993609-38ee-4cc3-b97f-75c88fcd8888 for instance af7a8803-c332-4dde-baee-ec2049243bf4 on hv-cinder-85221 Sep 06 16:17:44.733711 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-51674cf7-6201-490d-bdff-ec5f88119fca req-aa3cb53e-58c7-4181-8b88-427c0183b8db service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066581 Sep 06 16:17:44.734326 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 159/306] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:44.754127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-930a45ba-2a92-4400-9216-f884b684dffa tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:44.755216 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-930a45ba-2a92-4400-9216-f884b684dffa tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:44.767933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-930a45ba-2a92-4400-9216-f884b684dffa tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:44.768866 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-930a45ba-2a92-4400-9216-f884b684dffa tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:44.769619 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-930a45ba-2a92-4400-9216-f884b684dffa tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:44.770763 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-930a45ba-2a92-4400-9216-f884b684dffa tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:44.771520 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-930a45ba-2a92-4400-9216-f884b684dffa tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:44.772680 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-930a45ba-2a92-4400-9216-f884b684dffa tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:44.908192 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-930a45ba-2a92-4400-9216-f884b684dffa tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:44.918369 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-930a45ba-2a92-4400-9216-f884b684dffa tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1346 microversion: 2.1 time: 0.186651 Sep 06 16:17:44.919868 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 148/307] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:44 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1346 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:44.995658 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-41e7adb2-d74b-4fc3-b88d-707e115a8d61 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:44.996341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-41e7adb2-d74b-4fc3-b88d-707e115a8d61 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:45.008205 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-41e7adb2-d74b-4fc3-b88d-707e115a8d61 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:45.008883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-41e7adb2-d74b-4fc3-b88d-707e115a8d61 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:45.009510 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-41e7adb2-d74b-4fc3-b88d-707e115a8d61 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:45.010246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-41e7adb2-d74b-4fc3-b88d-707e115a8d61 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:45.010968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-41e7adb2-d74b-4fc3-b88d-707e115a8d61 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:45.011532 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-41e7adb2-d74b-4fc3-b88d-707e115a8d61 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:45.232871 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-41e7adb2-d74b-4fc3-b88d-707e115a8d61 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:45.254277 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-41e7adb2-d74b-4fc3-b88d-707e115a8d61 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.261264 Sep 06 16:17:45.257745 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 160/308] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:44 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:45.944004 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:45.945245 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:45.955594 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:45.956063 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:45.958177 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:45.959171 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:45.959652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:45.960082 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:46.038999 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:46.041747 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:46.042822 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:46.043898 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lazy-loading 'fault' on Instance uuid af7a8803-c332-4dde-baee-ec2049243bf4 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:17:46.126128 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978e7cc78ab4c559dfd3e22cde34569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66250df2e054415b517b2de8857bc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:46.136999 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a0bfc18e-49ea-4bbf-99f4-9847a7a3749e tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 200 len: 1351 microversion: 2.1 time: 0.196050 Sep 06 16:17:46.137592 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 149/309] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:45 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 1351 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:46.287312 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ae87801f-3fe7-4724-82c7-abbc57e0cef3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:46.287925 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ae87801f-3fe7-4724-82c7-abbc57e0cef3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:46.291837 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=64 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:46.304957 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ae87801f-3fe7-4724-82c7-abbc57e0cef3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:46.305589 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ae87801f-3fe7-4724-82c7-abbc57e0cef3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:46.306037 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ae87801f-3fe7-4724-82c7-abbc57e0cef3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:46.310463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ae87801f-3fe7-4724-82c7-abbc57e0cef3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:46.311008 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ae87801f-3fe7-4724-82c7-abbc57e0cef3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:46.311738 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ae87801f-3fe7-4724-82c7-abbc57e0cef3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:46.507641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ae87801f-3fe7-4724-82c7-abbc57e0cef3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:46.525152 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ae87801f-3fe7-4724-82c7-abbc57e0cef3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.241088 Sep 06 16:17:46.526455 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 161/310] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:46 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:47.167851 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-af45d40e-d435-45ea-968b-6a6ee041296a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:47.169653 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-af45d40e-d435-45ea-968b-6a6ee041296a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:47.184804 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-af45d40e-d435-45ea-968b-6a6ee041296a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:47.185670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-af45d40e-d435-45ea-968b-6a6ee041296a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:47.190343 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-af45d40e-d435-45ea-968b-6a6ee041296a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:47.191357 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-af45d40e-d435-45ea-968b-6a6ee041296a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:47.192136 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-af45d40e-d435-45ea-968b-6a6ee041296a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:47.193770 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-af45d40e-d435-45ea-968b-6a6ee041296a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:47.213045 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-af45d40e-d435-45ea-968b-6a6ee041296a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] HTTP exception thrown: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-af45d40e-d435-45ea-968b-6a6ee041296a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Request method failure captured: Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 HTTP/1.1 Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3JBx_w138I8dcNf4SngUxJ2SYSBzUKmO8St35dQLOtqVfbayU2lCpGpOr07l1C6SQ10DGBvNlwhxS-jOd88ywlrcJ6IqFHzRnAd7ekVA_-kfDaIvadysZwxjzN_fA26zHJxBkEOGcRwX6vyRnS7rDm_9joBvvx730GmNA9INaLtcuw Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: c66250df2e054415b517b2de8857bc87 Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-DeleteServersTestJSON-499705229 Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:17:47.218279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:17:47.219583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c66250df2e054415b517b2de8857bc87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c66250df2e054415b517b2de8857bc87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c66250df2e054415b517b2de8857bc87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c66250df2e054415b517b2de8857bc87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:17:47.219583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-DeleteServersTestJSON-499705229 Sep 06 16:17:47.219583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: c66250df2e054415b517b2de8857bc87 Sep 06 16:17:47.219583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-DeleteServersTestJSON-499705229 Sep 06 16:17:47.219583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-DeleteServersTestJSON-499705229-project Sep 06 16:17:47.219583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:17:47.219583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:17:47.219583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 8978e7cc78ab4c559dfd3e22cde34569 Sep 06 16:17:47.219583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-DeleteServersTestJSON-499705229-project Sep 06 16:17:47.219583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:17:47.219583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:47.219583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'af7a8803-c332-4dde-baee-ec2049243bf4'} Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:17:47.220308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:47.221694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:47.223226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-af45d40e-d435-45ea-968b-6a6ee041296a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Returning 404 to user: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:17:47.223226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-af45d40e-d435-45ea-968b-6a6ee041296a tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 404 len: 111 microversion: 2.1 time: 0.060708 Sep 06 16:17:47.223226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 150/311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:47 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:17:47.391393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f5b07e1d-3072-4a51-8171-6e873149c122 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:47.393877 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f5b07e1d-3072-4a51-8171-6e873149c122 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:47.400341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5b07e1d-3072-4a51-8171-6e873149c122 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:47.400850 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5b07e1d-3072-4a51-8171-6e873149c122 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:47.401461 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5b07e1d-3072-4a51-8171-6e873149c122 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:47.402171 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5b07e1d-3072-4a51-8171-6e873149c122 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:47.402618 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5b07e1d-3072-4a51-8171-6e873149c122 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:47.403038 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5b07e1d-3072-4a51-8171-6e873149c122 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:47.417673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-f5b07e1d-3072-4a51-8171-6e873149c122 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] HTTP exception thrown: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f5b07e1d-3072-4a51-8171-6e873149c122 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Request method failure captured: Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4/os-volume_attachments HTTP/1.1 Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3JBx_w138I8dcNf4SngUxJ2SYSBzUKmO8St35dQLOtqVfbayU2lCpGpOr07l1C6SQ10DGBvNlwhxS-jOd88ywlrcJ6IqFHzRnAd7ekVA_-kfDaIvadysZwxjzN_fA26zHJxBkEOGcRwX6vyRnS7rDm_9joBvvx730GmNA9INaLtcuw Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: c66250df2e054415b517b2de8857bc87 Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-DeleteServersTestJSON-499705229 Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:17:47.422978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:17:47.424732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c66250df2e054415b517b2de8857bc87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c66250df2e054415b517b2de8857bc87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c66250df2e054415b517b2de8857bc87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c66250df2e054415b517b2de8857bc87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:17:47.424732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-DeleteServersTestJSON-499705229 Sep 06 16:17:47.424732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: c66250df2e054415b517b2de8857bc87 Sep 06 16:17:47.424732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-DeleteServersTestJSON-499705229 Sep 06 16:17:47.424732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-DeleteServersTestJSON-499705229-project Sep 06 16:17:47.424732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:17:47.424732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:17:47.424732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 8978e7cc78ab4c559dfd3e22cde34569 Sep 06 16:17:47.424732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-DeleteServersTestJSON-499705229-project Sep 06 16:17:47.424732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:17:47.424732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:47.424732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'server_id': 'af7a8803-c332-4dde-baee-ec2049243bf4'} Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:17:47.425832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:47.427550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:17:47.428938 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f5b07e1d-3072-4a51-8171-6e873149c122 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Returning 404 to user: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:17:47.428938 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f5b07e1d-3072-4a51-8171-6e873149c122 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038623 Sep 06 16:17:47.429688 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 162/312] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:17:47 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:17:47.562819 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-47a622a7-f5b1-47cd-a615-9261ead07cd5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:47.563439 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-47a622a7-f5b1-47cd-a615-9261ead07cd5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:47.577996 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47a622a7-f5b1-47cd-a615-9261ead07cd5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:47.578580 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47a622a7-f5b1-47cd-a615-9261ead07cd5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:47.582980 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47a622a7-f5b1-47cd-a615-9261ead07cd5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:47.584454 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47a622a7-f5b1-47cd-a615-9261ead07cd5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:47.585098 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47a622a7-f5b1-47cd-a615-9261ead07cd5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:47.585597 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47a622a7-f5b1-47cd-a615-9261ead07cd5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:47.967439 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-47a622a7-f5b1-47cd-a615-9261ead07cd5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:47.981570 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-47a622a7-f5b1-47cd-a615-9261ead07cd5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.424283 Sep 06 16:17:47.985110 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 151/313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:47 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:48.759406 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-94fa2067-dfdb-4916-86b1-16b5d2cbe1e5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:48.760431 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-94fa2067-dfdb-4916-86b1-16b5d2cbe1e5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:48.773718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-94fa2067-dfdb-4916-86b1-16b5d2cbe1e5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:48.774384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-94fa2067-dfdb-4916-86b1-16b5d2cbe1e5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:48.774841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-94fa2067-dfdb-4916-86b1-16b5d2cbe1e5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:48.775751 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-94fa2067-dfdb-4916-86b1-16b5d2cbe1e5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:48.776417 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-94fa2067-dfdb-4916-86b1-16b5d2cbe1e5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:48.776873 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-94fa2067-dfdb-4916-86b1-16b5d2cbe1e5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:48.798797 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-94fa2067-dfdb-4916-86b1-16b5d2cbe1e5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] HTTP exception thrown: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-94fa2067-dfdb-4916-86b1-16b5d2cbe1e5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Request method failure captured: Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: DELETE /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 HTTP/1.1 Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3JBx_w138I8dcNf4SngUxJ2SYSBzUKmO8St35dQLOtqVfbayU2lCpGpOr07l1C6SQ10DGBvNlwhxS-jOd88ywlrcJ6IqFHzRnAd7ekVA_-kfDaIvadysZwxjzN_fA26zHJxBkEOGcRwX6vyRnS7rDm_9joBvvx730GmNA9INaLtcuw Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: c66250df2e054415b517b2de8857bc87 Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-DeleteServersTestJSON-499705229 Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:17:48.802325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:17:48.803888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c66250df2e054415b517b2de8857bc87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c66250df2e054415b517b2de8857bc87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c66250df2e054415b517b2de8857bc87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c66250df2e054415b517b2de8857bc87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:17:48.803888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-DeleteServersTestJSON-499705229 Sep 06 16:17:48.803888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: c66250df2e054415b517b2de8857bc87 Sep 06 16:17:48.803888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-DeleteServersTestJSON-499705229 Sep 06 16:17:48.803888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-DeleteServersTestJSON-499705229-project Sep 06 16:17:48.803888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:17:48.803888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:17:48.803888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 8978e7cc78ab4c559dfd3e22cde34569 Sep 06 16:17:48.803888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-DeleteServersTestJSON-499705229-project Sep 06 16:17:48.803888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:17:48.803888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:48.803888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'af7a8803-c332-4dde-baee-ec2049243bf4'} Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:17:48.804773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:48.806165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:17:48.807525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-94fa2067-dfdb-4916-86b1-16b5d2cbe1e5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Returning 404 to user: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:17:48.807525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-94fa2067-dfdb-4916-86b1-16b5d2cbe1e5 tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "DELETE /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 404 len: 111 microversion: 2.1 time: 0.049176 Sep 06 16:17:48.807525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 163/314] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:17:48 2022] DELETE /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:17:48.819793 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f9aa0d5d-0bf7-4aac-9e8a-c540018c347d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:48.820924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f9aa0d5d-0bf7-4aac-9e8a-c540018c347d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] [instance: af7a8803-c332-4dde-baee-ec2049243bf4] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:48.833324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f9aa0d5d-0bf7-4aac-9e8a-c540018c347d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:48.834112 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f9aa0d5d-0bf7-4aac-9e8a-c540018c347d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:48.834732 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f9aa0d5d-0bf7-4aac-9e8a-c540018c347d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:48.836026 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f9aa0d5d-0bf7-4aac-9e8a-c540018c347d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:48.837309 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f9aa0d5d-0bf7-4aac-9e8a-c540018c347d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:48.838088 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f9aa0d5d-0bf7-4aac-9e8a-c540018c347d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:48.859422 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-f9aa0d5d-0bf7-4aac-9e8a-c540018c347d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] HTTP exception thrown: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f9aa0d5d-0bf7-4aac-9e8a-c540018c347d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Request method failure captured: Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 HTTP/1.1 Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3JBx_w138I8dcNf4SngUxJ2SYSBzUKmO8St35dQLOtqVfbayU2lCpGpOr07l1C6SQ10DGBvNlwhxS-jOd88ywlrcJ6IqFHzRnAd7ekVA_-kfDaIvadysZwxjzN_fA26zHJxBkEOGcRwX6vyRnS7rDm_9joBvvx730GmNA9INaLtcuw Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: c66250df2e054415b517b2de8857bc87 Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-DeleteServersTestJSON-499705229 Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:17:48.862380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:17:48.863908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c66250df2e054415b517b2de8857bc87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c66250df2e054415b517b2de8857bc87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c66250df2e054415b517b2de8857bc87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c66250df2e054415b517b2de8857bc87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:17:48.863908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-DeleteServersTestJSON-499705229 Sep 06 16:17:48.863908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: c66250df2e054415b517b2de8857bc87 Sep 06 16:17:48.863908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-DeleteServersTestJSON-499705229 Sep 06 16:17:48.863908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-DeleteServersTestJSON-499705229-project Sep 06 16:17:48.863908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:17:48.863908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:17:48.863908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 8978e7cc78ab4c559dfd3e22cde34569 Sep 06 16:17:48.863908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-DeleteServersTestJSON-499705229-project Sep 06 16:17:48.863908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:17:48.863908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:48.863908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'af7a8803-c332-4dde-baee-ec2049243bf4'} Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:17:48.864707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. Sep 06 16:17:48.866038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:48.868580 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f9aa0d5d-0bf7-4aac-9e8a-c540018c347d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] Returning 404 to user: Instance af7a8803-c332-4dde-baee-ec2049243bf4 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:17:48.869967 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f9aa0d5d-0bf7-4aac-9e8a-c540018c347d tempest-DeleteServersTestJSON-499705229 tempest-DeleteServersTestJSON-499705229-project] 10.222.0.43 "GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4" status: 404 len: 111 microversion: 2.1 time: 0.055125 Sep 06 16:17:48.871252 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 152/315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:48 2022] GET /compute/v2.1/servers/af7a8803-c332-4dde-baee-ec2049243bf4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 16:17:49.013646 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-8c6c3ea4-e2a0-47aa-85c7-1cb1b074c47d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:49.018354 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-8c6c3ea4-e2a0-47aa-85c7-1cb1b074c47d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:49.043445 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8c6c3ea4-e2a0-47aa-85c7-1cb1b074c47d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:49.046945 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8c6c3ea4-e2a0-47aa-85c7-1cb1b074c47d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:49.047637 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8c6c3ea4-e2a0-47aa-85c7-1cb1b074c47d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:49.048890 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8c6c3ea4-e2a0-47aa-85c7-1cb1b074c47d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:49.050088 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8c6c3ea4-e2a0-47aa-85c7-1cb1b074c47d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:49.050901 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8c6c3ea4-e2a0-47aa-85c7-1cb1b074c47d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:49.414094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8c6c3ea4-e2a0-47aa-85c7-1cb1b074c47d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:49.424122 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-8c6c3ea4-e2a0-47aa-85c7-1cb1b074c47d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.419632 Sep 06 16:17:49.441701 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 164/316] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:49 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:50.474203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0b8f688f-c7a6-4fde-998f-3ec44fe3854a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:50.475147 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0b8f688f-c7a6-4fde-998f-3ec44fe3854a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:50.502290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b8f688f-c7a6-4fde-998f-3ec44fe3854a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:50.503810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b8f688f-c7a6-4fde-998f-3ec44fe3854a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:50.505365 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b8f688f-c7a6-4fde-998f-3ec44fe3854a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:50.507102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b8f688f-c7a6-4fde-998f-3ec44fe3854a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:50.515830 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b8f688f-c7a6-4fde-998f-3ec44fe3854a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:50.518608 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b8f688f-c7a6-4fde-998f-3ec44fe3854a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:50.881405 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0b8f688f-c7a6-4fde-998f-3ec44fe3854a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:50.890791 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0b8f688f-c7a6-4fde-998f-3ec44fe3854a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.433818 Sep 06 16:17:50.896040 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 153/317] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:50 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:51.929781 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-484a78ea-d9a0-4da9-a5cb-b26a6c2611a4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:51.932052 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-484a78ea-d9a0-4da9-a5cb-b26a6c2611a4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:51.946891 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-484a78ea-d9a0-4da9-a5cb-b26a6c2611a4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:51.948006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-484a78ea-d9a0-4da9-a5cb-b26a6c2611a4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:51.949120 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-484a78ea-d9a0-4da9-a5cb-b26a6c2611a4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:51.950937 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-484a78ea-d9a0-4da9-a5cb-b26a6c2611a4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:51.952172 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-484a78ea-d9a0-4da9-a5cb-b26a6c2611a4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:51.953177 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-484a78ea-d9a0-4da9-a5cb-b26a6c2611a4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:52.807623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-484a78ea-d9a0-4da9-a5cb-b26a6c2611a4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:52.846619 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-484a78ea-d9a0-4da9-a5cb-b26a6c2611a4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.924057 Sep 06 16:17:52.850518 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 165/318] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:51 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:53.881043 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9ee6542c-647f-4348-be74-d3d95b92cd03 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:53.882658 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9ee6542c-647f-4348-be74-d3d95b92cd03 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:53.904729 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9ee6542c-647f-4348-be74-d3d95b92cd03 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:53.906942 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9ee6542c-647f-4348-be74-d3d95b92cd03 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:53.907729 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9ee6542c-647f-4348-be74-d3d95b92cd03 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:53.908896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9ee6542c-647f-4348-be74-d3d95b92cd03 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:53.909692 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9ee6542c-647f-4348-be74-d3d95b92cd03 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:53.910362 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9ee6542c-647f-4348-be74-d3d95b92cd03 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:54.137699 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9ee6542c-647f-4348-be74-d3d95b92cd03 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:54.147356 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9ee6542c-647f-4348-be74-d3d95b92cd03 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.274256 Sep 06 16:17:54.148307 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 154/319] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:53 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:55.172830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-978714c1-a073-4f03-8326-0fc6ed69dd25 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:55.174289 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-978714c1-a073-4f03-8326-0fc6ed69dd25 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:55.189786 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-978714c1-a073-4f03-8326-0fc6ed69dd25 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:55.190721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-978714c1-a073-4f03-8326-0fc6ed69dd25 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:55.192899 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-978714c1-a073-4f03-8326-0fc6ed69dd25 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:55.194989 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-978714c1-a073-4f03-8326-0fc6ed69dd25 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:55.195814 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-978714c1-a073-4f03-8326-0fc6ed69dd25 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:55.196523 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-978714c1-a073-4f03-8326-0fc6ed69dd25 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:55.519113 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-978714c1-a073-4f03-8326-0fc6ed69dd25 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:55.533505 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-978714c1-a073-4f03-8326-0fc6ed69dd25 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.365879 Sep 06 16:17:55.534109 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 166/320] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:55 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:56.447364 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-646989949", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "networks": [{"uuid": "e817f63d-ad34-42f8-aaac-1bf67dac54b6"}]}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:56.552522 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] validate_networks() for [('e817f63d-ad34-42f8-aaac-1bf67dac54b6', None, None, None, None, None)] {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:17:56.559995 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-569384ae-5cc5-4474-8b9c-6008fa5b2ced tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:56.561694 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-569384ae-5cc5-4474-8b9c-6008fa5b2ced tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:56.573344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-569384ae-5cc5-4474-8b9c-6008fa5b2ced tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:56.574981 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-569384ae-5cc5-4474-8b9c-6008fa5b2ced tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:56.576439 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-569384ae-5cc5-4474-8b9c-6008fa5b2ced tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:56.577443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-569384ae-5cc5-4474-8b9c-6008fa5b2ced tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:56.578110 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-569384ae-5cc5-4474-8b9c-6008fa5b2ced tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:56.578744 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-569384ae-5cc5-4474-8b9c-6008fa5b2ced tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:56.926376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-569384ae-5cc5-4474-8b9c-6008fa5b2ced tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:56.935279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-569384ae-5cc5-4474-8b9c-6008fa5b2ced tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.380799 Sep 06 16:17:56.936123 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 167/321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:56 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:57.345090 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:17:57.345524 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:17:57.346660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:17:57.347017 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:17:57.355342 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:17:57.365960 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:57.377917 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:57.378565 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:57.379558 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:57.380658 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:57.381320 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:57.381908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:57.410493 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Getting quotas for project 4a2dcd76a5f24bd7ba164032cbe22d20. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:17:57.416073 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Getting quotas for user 2921386cc370487da26a786c8198c94c and project 4a2dcd76a5f24bd7ba164032cbe22d20. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:17:57.433529 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:17:57.437015 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:17:57.522519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-010fa32f-0428-469e-89c4-c9dfc615c5f0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078355 Sep 06 16:17:57.524396 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 155/322] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:17:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:17:57.535636 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-dce8035a-ca33-487e-bf35-3b4f33b57f10 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:57.537425 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-dce8035a-ca33-487e-bf35-3b4f33b57f10 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:57.680570 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dce8035a-ca33-487e-bf35-3b4f33b57f10 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:57.693611 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-dce8035a-ca33-487e-bf35-3b4f33b57f10 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1213 microversion: 2.1 time: 0.163030 Sep 06 16:17:57.704779 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 168/323] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:57 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:57.958434 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9f5f614c-e172-49a2-834b-e0801c4572cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:57.959073 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9f5f614c-e172-49a2-834b-e0801c4572cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:57.964045 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-2ae5ba11-46e0-4bf5-9b1f-b46fc4089d3f tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Action: 'create', calling method: .version_select at 0x7f83e95fb3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2007009845", "metadata": {"Type": "work"}}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:57.972249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9f5f614c-e172-49a2-834b-e0801c4572cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:57.974749 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9f5f614c-e172-49a2-834b-e0801c4572cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:57.975193 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9f5f614c-e172-49a2-834b-e0801c4572cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:57.975928 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9f5f614c-e172-49a2-834b-e0801c4572cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:57.976384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9f5f614c-e172-49a2-834b-e0801c4572cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:57.981282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9f5f614c-e172-49a2-834b-e0801c4572cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-2ae5ba11-46e0-4bf5-9b1f-b46fc4089d3f tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Request method failure captured: Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 122 Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3K1H2sDASxFmAU7mprsAXVSAznBCRUHf-nGaTrWeO_2l-w7AU8m94rZ7C2PeTODLHaPEFYGI-37sqcciVK2sMI1e2obOYRE887Dr3e6gR6STg6QfCS_m_d_UmTfJusHnO22fe-lk73bXWUcnhvvGYWPaohXdop7wZ83lfsSXEKOyYA Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 0fe959bc8c9a409a94150e6683faff45 Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:17:57.984332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 0fe959bc8c9a409a94150e6683faff45 Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesNegativeTest-10988622-project Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 7865b032e8a5471c9727a82aa5278647 Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesNegativeTest-10988622-project Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2007009845", "metadata": {"Type": "work"}}} Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: Sep 06 16:17:57.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2007009845', 'metadata': {'Type': 'work'}}}} Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise error Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi '#$%' Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:17:57.990844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 16:17:57.992298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 16:17:57.993373 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 16:17:57.993373 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:57.993373 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-2ae5ba11-46e0-4bf5-9b1f-b46fc4089d3f tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:17:57.993373 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-2ae5ba11-46e0-4bf5-9b1f-b46fc4089d3f tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.379052 Sep 06 16:17:57.993373 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 156/324] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Sep 6 16:17:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 381 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:17:57.997361 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-91b24a58-966a-4fe7-9b5a-7fba1f3186f7 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Action: 'create', calling method: .version_select at 0x7f83e9673670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1561003701", "metadata": {"Type": "work"}}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-91b24a58-966a-4fe7-9b5a-7fba1f3186f7 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Request method failure captured: Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 120 Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3K1H2sDASxFmAU7mprsAXVSAznBCRUHf-nGaTrWeO_2l-w7AU8m94rZ7C2PeTODLHaPEFYGI-37sqcciVK2sMI1e2obOYRE887Dr3e6gR6STg6QfCS_m_d_UmTfJusHnO22fe-lk73bXWUcnhvvGYWPaohXdop7wZ83lfsSXEKOyYA Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 0fe959bc8c9a409a94150e6683faff45 Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:17:58.004372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 0fe959bc8c9a409a94150e6683faff45 Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesNegativeTest-10988622-project Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 7865b032e8a5471c9727a82aa5278647 Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesNegativeTest-10988622-project Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1561003701", "metadata": {"Type": "work"}}} Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: Sep 06 16:17:58.005810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1561003701', 'metadata': {'Type': 'work'}}}} Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise error Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi '0' Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:17:58.006649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 16:17:58.007988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 16:17:58.009678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 16:17:58.009678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.009678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-91b24a58-966a-4fe7-9b5a-7fba1f3186f7 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:17:58.010780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-91b24a58-966a-4fe7-9b5a-7fba1f3186f7 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018330 Sep 06 16:17:58.016314 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 157/325] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Sep 6 16:17:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 16:17:58.030785 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-201aa605-6987-450b-be1d-30695eeca62b tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Action: 'create', calling method: .version_select at 0x7f83e9651e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1081050917", "metadata": {"Type": "work"}}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-201aa605-6987-450b-be1d-30695eeca62b tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Request method failure captured: Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 119 Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3K1H2sDASxFmAU7mprsAXVSAznBCRUHf-nGaTrWeO_2l-w7AU8m94rZ7C2PeTODLHaPEFYGI-37sqcciVK2sMI1e2obOYRE887Dr3e6gR6STg6QfCS_m_d_UmTfJusHnO22fe-lk73bXWUcnhvvGYWPaohXdop7wZ83lfsSXEKOyYA Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 0fe959bc8c9a409a94150e6683faff45 Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:17:58.041823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 0fe959bc8c9a409a94150e6683faff45 Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesNegativeTest-10988622-project Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 7865b032e8a5471c9727a82aa5278647 Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesNegativeTest-10988622-project Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1081050917", "metadata": {"Type": "work"}}} Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: Sep 06 16:17:58.043553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1081050917', 'metadata': {'Type': 'work'}}}} Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise error Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi '' Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:17:58.044572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 16:17:58.046060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 16:17:58.047070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 16:17:58.047070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.047070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-201aa605-6987-450b-be1d-30695eeca62b tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:17:58.047070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-201aa605-6987-450b-be1d-30695eeca62b tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024170 Sep 06 16:17:58.049790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 158/326] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Sep 6 16:17:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:17:58.067193 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a565f774-40c5-41e5-8bca-1ae17101bdab tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Calling method '.version_select at 0x7f83e9651b80>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:58.117453 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-a565f774-40c5-41e5-8bca-1ae17101bdab tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] HTTP exception thrown: Volume tempest-invalid-139000287 could not be found. Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a565f774-40c5-41e5-8bca-1ae17101bdab tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Request method failure captured: Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-139000287 HTTP/1.1 Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3K1H2sDASxFmAU7mprsAXVSAznBCRUHf-nGaTrWeO_2l-w7AU8m94rZ7C2PeTODLHaPEFYGI-37sqcciVK2sMI1e2obOYRE887Dr3e6gR6STg6QfCS_m_d_UmTfJusHnO22fe-lk73bXWUcnhvvGYWPaohXdop7wZ83lfsSXEKOyYA Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 0fe959bc8c9a409a94150e6683faff45 Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:17:58.122905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 0fe959bc8c9a409a94150e6683faff45 Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesNegativeTest-10988622-project Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 7865b032e8a5471c9727a82aa5278647 Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesNegativeTest-10988622-project Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Volume tempest-invalid-139000287 could not be found. Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'tempest-invalid-139000287'} Sep 06 16:17:58.124500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-139000287 could not be found. (HTTP 404) (Request-ID: req-62e16db8-e943-4103-ba83-82169f1deebb) Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.125432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 16:17:58.126754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-139000287 could not be found. Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:17:58.128129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-139000287 could not be found. Sep 06 16:17:58.129276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.129276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.129276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.129276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.129276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:58.129276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:58.129276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:17:58.129276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:17:58.129276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-139000287 could not be found. Sep 06 16:17:58.129276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.131236 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a565f774-40c5-41e5-8bca-1ae17101bdab tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Returning 404 to user: Volume tempest-invalid-139000287 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:17:58.133538 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a565f774-40c5-41e5-8bca-1ae17101bdab tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-139000287" status: 404 len: 98 microversion: 2.1 time: 0.081963 Sep 06 16:17:58.136379 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 159/327] 10.222.0.43 () {58 vars in 1215 bytes} [Tue Sep 6 16:17:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-139000287 => generated 98 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 16:17:58.157654 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-15c16720-302f-4faa-8bf0-c46d22039106 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012640 Sep 06 16:17:58.165558 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 160/328] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Sep 6 16:17:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 16:17:58.184492 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a84d43cc-9337-45d1-bb49-e1d785cfd38f tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012010 Sep 06 16:17:58.190475 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 161/329] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Sep 6 16:17:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 16:17:58.213322 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ae39ca05-3b5a-4fe5-b2f2-0dc3420e5a64 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Calling method '.version_select at 0x7f83e95fb940>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:58.295062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-ae39ca05-3b5a-4fe5-b2f2-0dc3420e5a64 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] HTTP exception thrown: Volume c76d547a-a6c1-4d16-9377-7a35bf680ca5 could not be found. Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ae39ca05-3b5a-4fe5-b2f2-0dc3420e5a64 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Request method failure captured: Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: DELETE /compute/v2.1/os-volumes/c76d547a-a6c1-4d16-9377-7a35bf680ca5 HTTP/1.1 Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3K1H2sDASxFmAU7mprsAXVSAznBCRUHf-nGaTrWeO_2l-w7AU8m94rZ7C2PeTODLHaPEFYGI-37sqcciVK2sMI1e2obOYRE887Dr3e6gR6STg6QfCS_m_d_UmTfJusHnO22fe-lk73bXWUcnhvvGYWPaohXdop7wZ83lfsSXEKOyYA Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 0fe959bc8c9a409a94150e6683faff45 Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:17:58.299531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 0fe959bc8c9a409a94150e6683faff45 Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesNegativeTest-10988622-project Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 7865b032e8a5471c9727a82aa5278647 Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesNegativeTest-10988622-project Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Volume c76d547a-a6c1-4d16-9377-7a35bf680ca5 could not be found. Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'c76d547a-a6c1-4d16-9377-7a35bf680ca5'} Sep 06 16:17:58.302464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c76d547a-a6c1-4d16-9377-7a35bf680ca5 could not be found. (HTTP 404) (Request-ID: req-5c44a3db-8df5-49c5-9da6-484eced3c352) Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.304070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 16:17:58.313645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c76d547a-a6c1-4d16-9377-7a35bf680ca5 could not be found. Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 16:17:58.317386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c76d547a-a6c1-4d16-9377-7a35bf680ca5 could not be found. Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c76d547a-a6c1-4d16-9377-7a35bf680ca5 could not be found. Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ae39ca05-3b5a-4fe5-b2f2-0dc3420e5a64 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Returning 404 to user: Volume c76d547a-a6c1-4d16-9377-7a35bf680ca5 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ae39ca05-3b5a-4fe5-b2f2-0dc3420e5a64 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/c76d547a-a6c1-4d16-9377-7a35bf680ca5" status: 404 len: 109 microversion: 2.1 time: 0.111124 Sep 06 16:17:58.319528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 162/330] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 6 16:17:58 2022] DELETE /compute/v2.1/os-volumes/c76d547a-a6c1-4d16-9377-7a35bf680ca5 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:17:58.323380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e0e9e374-2a39-48aa-bf01-15e33fce9a23 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Calling method '.version_select at 0x7f83e9613dc0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:58.415265 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-e0e9e374-2a39-48aa-bf01-15e33fce9a23 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] HTTP exception thrown: Volume 64774dad-f08b-42ff-8181-01b913569ed7 could not be found. Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e0e9e374-2a39-48aa-bf01-15e33fce9a23 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Request method failure captured: Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/os-volumes/64774dad-f08b-42ff-8181-01b913569ed7 HTTP/1.1 Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3K1H2sDASxFmAU7mprsAXVSAznBCRUHf-nGaTrWeO_2l-w7AU8m94rZ7C2PeTODLHaPEFYGI-37sqcciVK2sMI1e2obOYRE887Dr3e6gR6STg6QfCS_m_d_UmTfJusHnO22fe-lk73bXWUcnhvvGYWPaohXdop7wZ83lfsSXEKOyYA Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 0fe959bc8c9a409a94150e6683faff45 Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:17:58.418411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0fe959bc8c9a409a94150e6683faff45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 0fe959bc8c9a409a94150e6683faff45 Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesNegativeTest-10988622 Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesNegativeTest-10988622-project Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 7865b032e8a5471c9727a82aa5278647 Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesNegativeTest-10988622-project Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Volume 64774dad-f08b-42ff-8181-01b913569ed7 could not be found. Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': '64774dad-f08b-42ff-8181-01b913569ed7'} Sep 06 16:17:58.419651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64774dad-f08b-42ff-8181-01b913569ed7 could not be found. (HTTP 404) (Request-ID: req-93f17109-1785-447a-8bd9-3f6eb1095098) Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.420381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:17:58.430470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64774dad-f08b-42ff-8181-01b913569ed7 could not be found. Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 16:17:58.432487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64774dad-f08b-42ff-8181-01b913569ed7 could not be found. Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64774dad-f08b-42ff-8181-01b913569ed7 could not be found. Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e0e9e374-2a39-48aa-bf01-15e33fce9a23 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] Returning 404 to user: Volume 64774dad-f08b-42ff-8181-01b913569ed7 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e0e9e374-2a39-48aa-bf01-15e33fce9a23 tempest-VolumesNegativeTest-10988622 tempest-VolumesNegativeTest-10988622-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/64774dad-f08b-42ff-8181-01b913569ed7" status: 404 len: 109 microversion: 2.1 time: 0.104368 Sep 06 16:17:58.433983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 163/331] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:17:58 2022] GET /compute/v2.1/os-volumes/64774dad-f08b-42ff-8181-01b913569ed7 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:17:58.535328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9f5f614c-e172-49a2-834b-e0801c4572cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:58.549420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9f5f614c-e172-49a2-834b-e0801c4572cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.594846 Sep 06 16:17:58.553477 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 169/332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:57 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:58.743816 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-49410ea2-40f9-47da-b103-26b035cf9873 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:58.746651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-49410ea2-40f9-47da-b103-26b035cf9873 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:58.780449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49410ea2-40f9-47da-b103-26b035cf9873 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:58.785871 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49410ea2-40f9-47da-b103-26b035cf9873 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:58.788300 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49410ea2-40f9-47da-b103-26b035cf9873 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:58.802756 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49410ea2-40f9-47da-b103-26b035cf9873 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:58.806181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49410ea2-40f9-47da-b103-26b035cf9873 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:58.807608 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49410ea2-40f9-47da-b103-26b035cf9873 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:58.847286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:59.194073 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-49410ea2-40f9-47da-b103-26b035cf9873 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:59.205393 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-49410ea2-40f9-47da-b103-26b035cf9873 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1209 microversion: 2.1 time: 0.487981 Sep 06 16:17:59.207010 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 164/333] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:58 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1209 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:59.608346 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9253af99-5a9d-4ca1-9886-e22b335b838c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:59.609072 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9253af99-5a9d-4ca1-9886-e22b335b838c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:59.622433 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9253af99-5a9d-4ca1-9886-e22b335b838c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:59.622926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9253af99-5a9d-4ca1-9886-e22b335b838c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:59.623356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9253af99-5a9d-4ca1-9886-e22b335b838c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:59.624078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9253af99-5a9d-4ca1-9886-e22b335b838c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:59.627350 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9253af99-5a9d-4ca1-9886-e22b335b838c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:59.629276 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9253af99-5a9d-4ca1-9886-e22b335b838c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:59.772424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:00.202998 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9253af99-5a9d-4ca1-9886-e22b335b838c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:00.232600 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8f2c2e81-aa4e-4ddd-b283-cc2773f9daba tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:00.234420 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8f2c2e81-aa4e-4ddd-b283-cc2773f9daba tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:00.262198 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9253af99-5a9d-4ca1-9886-e22b335b838c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.655214 Sep 06 16:18:00.267843 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f2c2e81-aa4e-4ddd-b283-cc2773f9daba tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:00.271584 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 170/334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:59 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:00.273970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f2c2e81-aa4e-4ddd-b283-cc2773f9daba tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:00.281361 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f2c2e81-aa4e-4ddd-b283-cc2773f9daba tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:00.284071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f2c2e81-aa4e-4ddd-b283-cc2773f9daba tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:00.293037 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f2c2e81-aa4e-4ddd-b283-cc2773f9daba tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:00.296542 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f2c2e81-aa4e-4ddd-b283-cc2773f9daba tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:00.541838 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8f2c2e81-aa4e-4ddd-b283-cc2773f9daba tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:00.552414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8f2c2e81-aa4e-4ddd-b283-cc2773f9daba tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1271 microversion: 2.1 time: 0.325067 Sep 06 16:18:00.556271 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 165/335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:00 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1271 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:01.304125 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6d3edd75-f64b-418e-b91a-2ec4a29a87cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:01.305107 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6d3edd75-f64b-418e-b91a-2ec4a29a87cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:01.320057 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6d3edd75-f64b-418e-b91a-2ec4a29a87cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:01.320573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6d3edd75-f64b-418e-b91a-2ec4a29a87cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:01.321070 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6d3edd75-f64b-418e-b91a-2ec4a29a87cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:01.321925 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6d3edd75-f64b-418e-b91a-2ec4a29a87cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:01.322493 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6d3edd75-f64b-418e-b91a-2ec4a29a87cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:01.323034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6d3edd75-f64b-418e-b91a-2ec4a29a87cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:01.572594 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6d3edd75-f64b-418e-b91a-2ec4a29a87cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:01.582481 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-846d2a01-f989-4386-85f3-ce9c49fc93da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:01.583076 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-846d2a01-f989-4386-85f3-ce9c49fc93da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:01.597910 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6d3edd75-f64b-418e-b91a-2ec4a29a87cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.298142 Sep 06 16:18:01.621359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-846d2a01-f989-4386-85f3-ce9c49fc93da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:01.621970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-846d2a01-f989-4386-85f3-ce9c49fc93da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:01.623508 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 171/336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:01 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:01.624046 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-846d2a01-f989-4386-85f3-ce9c49fc93da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:01.627429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-846d2a01-f989-4386-85f3-ce9c49fc93da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:01.628453 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-846d2a01-f989-4386-85f3-ce9c49fc93da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:01.632222 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-846d2a01-f989-4386-85f3-ce9c49fc93da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:01.775664 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-846d2a01-f989-4386-85f3-ce9c49fc93da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:01.797659 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-846d2a01-f989-4386-85f3-ce9c49fc93da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1271 microversion: 2.1 time: 0.220603 Sep 06 16:18:01.801027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 166/337] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:01 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:02.628923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ca537e8b-9edc-4120-ad15-ca6a067963d1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:02.629541 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ca537e8b-9edc-4120-ad15-ca6a067963d1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:02.644883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ca537e8b-9edc-4120-ad15-ca6a067963d1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:02.646612 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ca537e8b-9edc-4120-ad15-ca6a067963d1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:02.647361 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ca537e8b-9edc-4120-ad15-ca6a067963d1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:02.648429 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ca537e8b-9edc-4120-ad15-ca6a067963d1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:02.649135 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ca537e8b-9edc-4120-ad15-ca6a067963d1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:02.650242 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ca537e8b-9edc-4120-ad15-ca6a067963d1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:02.828743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-91033afa-2984-4a50-929f-c53c49140b87 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:02.829900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-91033afa-2984-4a50-929f-c53c49140b87 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:02.852497 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-91033afa-2984-4a50-929f-c53c49140b87 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:02.856280 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-91033afa-2984-4a50-929f-c53c49140b87 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:02.857780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-91033afa-2984-4a50-929f-c53c49140b87 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:02.859074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-91033afa-2984-4a50-929f-c53c49140b87 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:02.859776 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-91033afa-2984-4a50-929f-c53c49140b87 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:02.860438 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-91033afa-2984-4a50-929f-c53c49140b87 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:02.885828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ca537e8b-9edc-4120-ad15-ca6a067963d1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:02.897361 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ca537e8b-9edc-4120-ad15-ca6a067963d1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.273787 Sep 06 16:18:02.898478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 172/338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:02 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:03.435688 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-91033afa-2984-4a50-929f-c53c49140b87 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:03.445602 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-91033afa-2984-4a50-929f-c53c49140b87 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.625597 Sep 06 16:18:03.446189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 167/339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:02 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:03.880626 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-31a28f26-c292-4e32-80c4-8ea06b13521a req-c0e84f39-5469-41ba-aa4a-a243d0390c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449e6106-faac-4d42-b021-674742c4d201", "tag": "d19f49a2-3073-4f0d-88df-4536fe68481f"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:03.901333 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-31a28f26-c292-4e32-80c4-8ea06b13521a req-c0e84f39-5469-41ba-aa4a-a243d0390c60 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:03.903188 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-31a28f26-c292-4e32-80c4-8ea06b13521a req-c0e84f39-5469-41ba-aa4a-a243d0390c60 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:03.903625 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-31a28f26-c292-4e32-80c4-8ea06b13521a req-c0e84f39-5469-41ba-aa4a-a243d0390c60 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:03.922385 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-67785e5a-f9de-427d-9c25-ec0a12a8ac86 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:03.923142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-67785e5a-f9de-427d-9c25-ec0a12a8ac86 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:03.926517 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-31a28f26-c292-4e32-80c4-8ea06b13521a req-c0e84f39-5469-41ba-aa4a-a243d0390c60 service nova] Creating event network-changed:d19f49a2-3073-4f0d-88df-4536fe68481f for instance 449e6106-faac-4d42-b021-674742c4d201 on hv-cinder-85221 Sep 06 16:18:03.930170 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67785e5a-f9de-427d-9c25-ec0a12a8ac86 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:03.932670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67785e5a-f9de-427d-9c25-ec0a12a8ac86 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:03.937880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-31a28f26-c292-4e32-80c4-8ea06b13521a req-c0e84f39-5469-41ba-aa4a-a243d0390c60 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061227 Sep 06 16:18:03.938730 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67785e5a-f9de-427d-9c25-ec0a12a8ac86 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:03.939569 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67785e5a-f9de-427d-9c25-ec0a12a8ac86 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:03.940239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67785e5a-f9de-427d-9c25-ec0a12a8ac86 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:03.940511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67785e5a-f9de-427d-9c25-ec0a12a8ac86 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:03.947702 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 173/340] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:18:04.394213 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-67785e5a-f9de-427d-9c25-ec0a12a8ac86 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:04.411731 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-67785e5a-f9de-427d-9c25-ec0a12a8ac86 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.493052 Sep 06 16:18:04.414049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 168/341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:03 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:04.475437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-353ef27b-8c44-49a7-bef7-1f7d3e85d0d2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:04.476286 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-353ef27b-8c44-49a7-bef7-1f7d3e85d0d2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:04.487756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-353ef27b-8c44-49a7-bef7-1f7d3e85d0d2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:04.488399 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-353ef27b-8c44-49a7-bef7-1f7d3e85d0d2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:04.489003 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-353ef27b-8c44-49a7-bef7-1f7d3e85d0d2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:04.489802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-353ef27b-8c44-49a7-bef7-1f7d3e85d0d2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:04.490485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-353ef27b-8c44-49a7-bef7-1f7d3e85d0d2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:04.491172 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-353ef27b-8c44-49a7-bef7-1f7d3e85d0d2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:04.724350 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-353ef27b-8c44-49a7-bef7-1f7d3e85d0d2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:04.757466 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-353ef27b-8c44-49a7-bef7-1f7d3e85d0d2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.286846 Sep 06 16:18:04.757466 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 174/342] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:04 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:05.449871 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-dc303aca-2ec6-45c6-94b9-810942d995a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:05.451087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-dc303aca-2ec6-45c6-94b9-810942d995a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:05.464724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dc303aca-2ec6-45c6-94b9-810942d995a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:05.466026 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dc303aca-2ec6-45c6-94b9-810942d995a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:05.467077 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dc303aca-2ec6-45c6-94b9-810942d995a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:05.468327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dc303aca-2ec6-45c6-94b9-810942d995a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:05.469229 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dc303aca-2ec6-45c6-94b9-810942d995a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:05.469919 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dc303aca-2ec6-45c6-94b9-810942d995a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:05.687689 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-dc303aca-2ec6-45c6-94b9-810942d995a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:05.703160 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-dc303aca-2ec6-45c6-94b9-810942d995a1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.261610 Sep 06 16:18:05.704572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 169/343] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:05 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:05.796113 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4a48b4f0-79c6-41c5-bafa-29a24fc2627a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:05.797143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4a48b4f0-79c6-41c5-bafa-29a24fc2627a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:05.808460 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a48b4f0-79c6-41c5-bafa-29a24fc2627a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:05.809659 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a48b4f0-79c6-41c5-bafa-29a24fc2627a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:05.810583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a48b4f0-79c6-41c5-bafa-29a24fc2627a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:05.812394 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a48b4f0-79c6-41c5-bafa-29a24fc2627a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:05.813456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a48b4f0-79c6-41c5-bafa-29a24fc2627a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:05.814658 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a48b4f0-79c6-41c5-bafa-29a24fc2627a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:06.037458 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4a48b4f0-79c6-41c5-bafa-29a24fc2627a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:06.050263 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4a48b4f0-79c6-41c5-bafa-29a24fc2627a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.259433 Sep 06 16:18:06.051831 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 175/344] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:05 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:06.732495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-eaacedaa-6a27-4d0c-887d-ae91026a0aff tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:06.733793 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-eaacedaa-6a27-4d0c-887d-ae91026a0aff tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:06.752002 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eaacedaa-6a27-4d0c-887d-ae91026a0aff tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:06.753735 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eaacedaa-6a27-4d0c-887d-ae91026a0aff tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:06.754876 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eaacedaa-6a27-4d0c-887d-ae91026a0aff tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:06.756173 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eaacedaa-6a27-4d0c-887d-ae91026a0aff tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:06.757599 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eaacedaa-6a27-4d0c-887d-ae91026a0aff tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:06.758496 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eaacedaa-6a27-4d0c-887d-ae91026a0aff tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:06.989312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-eaacedaa-6a27-4d0c-887d-ae91026a0aff tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:06.997656 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-eaacedaa-6a27-4d0c-887d-ae91026a0aff tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.272808 Sep 06 16:18:06.998237 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 170/345] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:06 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:07.075716 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-eaf0dbbf-6f90-4017-80a0-e22d2786e82b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:07.076596 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-eaf0dbbf-6f90-4017-80a0-e22d2786e82b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:07.083845 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eaf0dbbf-6f90-4017-80a0-e22d2786e82b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:07.084330 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eaf0dbbf-6f90-4017-80a0-e22d2786e82b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:07.084778 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eaf0dbbf-6f90-4017-80a0-e22d2786e82b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:07.085654 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eaf0dbbf-6f90-4017-80a0-e22d2786e82b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:07.086111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eaf0dbbf-6f90-4017-80a0-e22d2786e82b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:07.086785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eaf0dbbf-6f90-4017-80a0-e22d2786e82b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:07.243718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-eaf0dbbf-6f90-4017-80a0-e22d2786e82b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:07.258174 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-eaf0dbbf-6f90-4017-80a0-e22d2786e82b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.186619 Sep 06 16:18:07.274277 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 176/346] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:07 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:08.023480 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5b9cdd22-c1da-4088-98c3-29c45aa064e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:08.024801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5b9cdd22-c1da-4088-98c3-29c45aa064e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:08.026952 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:08.028171 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=6 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:08.042146 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5b9cdd22-c1da-4088-98c3-29c45aa064e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:08.042903 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5b9cdd22-c1da-4088-98c3-29c45aa064e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:08.043493 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5b9cdd22-c1da-4088-98c3-29c45aa064e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:08.044365 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5b9cdd22-c1da-4088-98c3-29c45aa064e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:08.044987 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5b9cdd22-c1da-4088-98c3-29c45aa064e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:08.045605 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5b9cdd22-c1da-4088-98c3-29c45aa064e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:08.207260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5b9cdd22-c1da-4088-98c3-29c45aa064e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:08.216743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5b9cdd22-c1da-4088-98c3-29c45aa064e6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.196992 Sep 06 16:18:08.218624 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 171/347] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:08 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:08.296581 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ad482bfb-a79b-4acc-b057-aec1e502a305 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:08.297212 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ad482bfb-a79b-4acc-b057-aec1e502a305 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:08.318566 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:08.320641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad482bfb-a79b-4acc-b057-aec1e502a305 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:08.321344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad482bfb-a79b-4acc-b057-aec1e502a305 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:08.322322 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad482bfb-a79b-4acc-b057-aec1e502a305 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:08.322625 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad482bfb-a79b-4acc-b057-aec1e502a305 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:08.323201 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad482bfb-a79b-4acc-b057-aec1e502a305 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:08.323761 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad482bfb-a79b-4acc-b057-aec1e502a305 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:08.498631 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ad482bfb-a79b-4acc-b057-aec1e502a305 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:08.507865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ad482bfb-a79b-4acc-b057-aec1e502a305 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.215555 Sep 06 16:18:08.509721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 177/348] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:08 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:09.241275 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f8f11a83-a450-4aa9-bfbb-594594b26316 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:09.241837 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f8f11a83-a450-4aa9-bfbb-594594b26316 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:09.253440 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f8f11a83-a450-4aa9-bfbb-594594b26316 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:09.253934 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f8f11a83-a450-4aa9-bfbb-594594b26316 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:09.254371 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f8f11a83-a450-4aa9-bfbb-594594b26316 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:09.255126 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f8f11a83-a450-4aa9-bfbb-594594b26316 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:09.255580 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f8f11a83-a450-4aa9-bfbb-594594b26316 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:09.256008 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f8f11a83-a450-4aa9-bfbb-594594b26316 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:09.483677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f8f11a83-a450-4aa9-bfbb-594594b26316 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:09.493530 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f8f11a83-a450-4aa9-bfbb-594594b26316 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.256379 Sep 06 16:18:09.494051 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 172/349] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:09 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:09.541483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d7a388a7-28d4-404c-87de-ebbbb55f6150 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:09.542572 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d7a388a7-28d4-404c-87de-ebbbb55f6150 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:09.571438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7a388a7-28d4-404c-87de-ebbbb55f6150 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:09.572340 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7a388a7-28d4-404c-87de-ebbbb55f6150 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:09.573325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7a388a7-28d4-404c-87de-ebbbb55f6150 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:09.574345 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7a388a7-28d4-404c-87de-ebbbb55f6150 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:09.575093 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7a388a7-28d4-404c-87de-ebbbb55f6150 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:09.575722 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d7a388a7-28d4-404c-87de-ebbbb55f6150 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:09.821033 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d7a388a7-28d4-404c-87de-ebbbb55f6150 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:09.830186 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d7a388a7-28d4-404c-87de-ebbbb55f6150 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.296251 Sep 06 16:18:09.831211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 178/350] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:09 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:10.517136 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6d58a96e-19f4-46e5-9438-178e808135af tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:10.517830 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6d58a96e-19f4-46e5-9438-178e808135af tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:10.528555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6d58a96e-19f4-46e5-9438-178e808135af tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:10.531922 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6d58a96e-19f4-46e5-9438-178e808135af tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:10.532552 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6d58a96e-19f4-46e5-9438-178e808135af tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:10.533460 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6d58a96e-19f4-46e5-9438-178e808135af tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:10.534217 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6d58a96e-19f4-46e5-9438-178e808135af tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:10.534890 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6d58a96e-19f4-46e5-9438-178e808135af tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:10.719029 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6d58a96e-19f4-46e5-9438-178e808135af tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:10.729880 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6d58a96e-19f4-46e5-9438-178e808135af tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.216979 Sep 06 16:18:10.730467 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 173/351] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:10 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:10.855600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c14e11c4-e16d-4f8b-a585-c27ae159fbd6 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:10.856225 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c14e11c4-e16d-4f8b-a585-c27ae159fbd6 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:10.872327 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c14e11c4-e16d-4f8b-a585-c27ae159fbd6 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:10.873203 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c14e11c4-e16d-4f8b-a585-c27ae159fbd6 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:10.873947 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c14e11c4-e16d-4f8b-a585-c27ae159fbd6 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:10.875134 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c14e11c4-e16d-4f8b-a585-c27ae159fbd6 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:10.875911 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c14e11c4-e16d-4f8b-a585-c27ae159fbd6 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:10.876586 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c14e11c4-e16d-4f8b-a585-c27ae159fbd6 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:11.036230 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c14e11c4-e16d-4f8b-a585-c27ae159fbd6 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:11.052519 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c14e11c4-e16d-4f8b-a585-c27ae159fbd6 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.200728 Sep 06 16:18:11.053120 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 179/352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:10 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:11.760729 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ac376b12-12a7-4e6c-9b9e-b1172363b270 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:11.762409 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ac376b12-12a7-4e6c-9b9e-b1172363b270 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:11.770706 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac376b12-12a7-4e6c-9b9e-b1172363b270 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:11.771202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac376b12-12a7-4e6c-9b9e-b1172363b270 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:11.771715 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac376b12-12a7-4e6c-9b9e-b1172363b270 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:11.772630 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac376b12-12a7-4e6c-9b9e-b1172363b270 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:11.773108 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac376b12-12a7-4e6c-9b9e-b1172363b270 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:11.773545 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac376b12-12a7-4e6c-9b9e-b1172363b270 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:11.930473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ac376b12-12a7-4e6c-9b9e-b1172363b270 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:11.938954 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ac376b12-12a7-4e6c-9b9e-b1172363b270 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.184772 Sep 06 16:18:11.939534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 174/353] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:11 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:12.079390 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-221c8431-7778-45c7-a3e7-bf97461d7b0f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:12.088246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-221c8431-7778-45c7-a3e7-bf97461d7b0f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:12.100819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-221c8431-7778-45c7-a3e7-bf97461d7b0f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:12.101447 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-221c8431-7778-45c7-a3e7-bf97461d7b0f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:12.101883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-221c8431-7778-45c7-a3e7-bf97461d7b0f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:12.103074 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-221c8431-7778-45c7-a3e7-bf97461d7b0f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:12.103655 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-221c8431-7778-45c7-a3e7-bf97461d7b0f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:12.104959 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-221c8431-7778-45c7-a3e7-bf97461d7b0f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:12.296658 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-221c8431-7778-45c7-a3e7-bf97461d7b0f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:12.305128 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-221c8431-7778-45c7-a3e7-bf97461d7b0f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.229486 Sep 06 16:18:12.305976 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 180/354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:12 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:12.963401 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-85219ac9-444d-48cf-b20e-3de3a45d7681 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:12.964464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-85219ac9-444d-48cf-b20e-3de3a45d7681 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:12.978966 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85219ac9-444d-48cf-b20e-3de3a45d7681 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:12.982513 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85219ac9-444d-48cf-b20e-3de3a45d7681 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:12.983302 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85219ac9-444d-48cf-b20e-3de3a45d7681 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:12.984276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85219ac9-444d-48cf-b20e-3de3a45d7681 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:12.985012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85219ac9-444d-48cf-b20e-3de3a45d7681 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:12.991061 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85219ac9-444d-48cf-b20e-3de3a45d7681 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:13.223571 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-85219ac9-444d-48cf-b20e-3de3a45d7681 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:13.233704 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-85219ac9-444d-48cf-b20e-3de3a45d7681 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.274788 Sep 06 16:18:13.237342 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 175/355] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:12 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:13.329928 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-52ba9a4f-3362-4ca8-9262-d7b08531436b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:13.330751 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-52ba9a4f-3362-4ca8-9262-d7b08531436b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:13.343422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-52ba9a4f-3362-4ca8-9262-d7b08531436b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:13.350094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-52ba9a4f-3362-4ca8-9262-d7b08531436b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:13.352669 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-52ba9a4f-3362-4ca8-9262-d7b08531436b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:13.353935 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-52ba9a4f-3362-4ca8-9262-d7b08531436b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:13.354456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-52ba9a4f-3362-4ca8-9262-d7b08531436b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:13.356243 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-52ba9a4f-3362-4ca8-9262-d7b08531436b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:13.567033 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-52ba9a4f-3362-4ca8-9262-d7b08531436b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:13.577235 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-52ba9a4f-3362-4ca8-9262-d7b08531436b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.251151 Sep 06 16:18:13.578000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 181/356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:13 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:14.266549 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-00d853de-3cfa-405f-8732-6544ac3f3138 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:14.267686 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-00d853de-3cfa-405f-8732-6544ac3f3138 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:14.293590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-00d853de-3cfa-405f-8732-6544ac3f3138 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:14.294851 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-00d853de-3cfa-405f-8732-6544ac3f3138 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:14.295900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-00d853de-3cfa-405f-8732-6544ac3f3138 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:14.297459 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-00d853de-3cfa-405f-8732-6544ac3f3138 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:14.298252 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-00d853de-3cfa-405f-8732-6544ac3f3138 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:14.299318 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-00d853de-3cfa-405f-8732-6544ac3f3138 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:14.527149 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-00d853de-3cfa-405f-8732-6544ac3f3138 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:14.535742 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-00d853de-3cfa-405f-8732-6544ac3f3138 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.274944 Sep 06 16:18:14.536335 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 176/357] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:14 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:14.601271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-654b3361-2236-4470-9c01-a1bf57b9a637 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:14.602637 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-654b3361-2236-4470-9c01-a1bf57b9a637 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:14.611369 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-654b3361-2236-4470-9c01-a1bf57b9a637 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:14.612061 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-654b3361-2236-4470-9c01-a1bf57b9a637 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:14.612614 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-654b3361-2236-4470-9c01-a1bf57b9a637 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:14.613538 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-654b3361-2236-4470-9c01-a1bf57b9a637 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:14.614194 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-654b3361-2236-4470-9c01-a1bf57b9a637 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:14.614833 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-654b3361-2236-4470-9c01-a1bf57b9a637 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:14.781511 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-654b3361-2236-4470-9c01-a1bf57b9a637 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:14.792905 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-654b3361-2236-4470-9c01-a1bf57b9a637 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.195483 Sep 06 16:18:14.806028 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 182/358] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:14 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:15.562827 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-72b6f2c0-1484-4bc8-8327-e3305a65ff3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:15.563890 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-72b6f2c0-1484-4bc8-8327-e3305a65ff3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:15.571428 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-72b6f2c0-1484-4bc8-8327-e3305a65ff3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:15.571893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-72b6f2c0-1484-4bc8-8327-e3305a65ff3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:15.572370 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-72b6f2c0-1484-4bc8-8327-e3305a65ff3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:15.573079 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-72b6f2c0-1484-4bc8-8327-e3305a65ff3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:15.573592 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-72b6f2c0-1484-4bc8-8327-e3305a65ff3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:15.574077 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-72b6f2c0-1484-4bc8-8327-e3305a65ff3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:15.754933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-72b6f2c0-1484-4bc8-8327-e3305a65ff3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:15.764844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-72b6f2c0-1484-4bc8-8327-e3305a65ff3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.209017 Sep 06 16:18:15.766056 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 177/359] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:15 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:15.821103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3c6e640a-06e7-4a1e-b4d5-7b00c3c7f404 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:15.822607 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3c6e640a-06e7-4a1e-b4d5-7b00c3c7f404 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:15.830020 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c6e640a-06e7-4a1e-b4d5-7b00c3c7f404 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:15.830815 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c6e640a-06e7-4a1e-b4d5-7b00c3c7f404 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:15.831398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c6e640a-06e7-4a1e-b4d5-7b00c3c7f404 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:15.833345 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c6e640a-06e7-4a1e-b4d5-7b00c3c7f404 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:15.834074 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c6e640a-06e7-4a1e-b4d5-7b00c3c7f404 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:15.834897 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c6e640a-06e7-4a1e-b4d5-7b00c3c7f404 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:16.062065 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3c6e640a-06e7-4a1e-b4d5-7b00c3c7f404 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:16.075138 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3c6e640a-06e7-4a1e-b4d5-7b00c3c7f404 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.261647 Sep 06 16:18:16.077133 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 183/360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:15 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:16.790575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-187ae9f7-ddc7-4c2f-9e6c-1de83c31a053 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:16.791249 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-187ae9f7-ddc7-4c2f-9e6c-1de83c31a053 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:16.799858 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-187ae9f7-ddc7-4c2f-9e6c-1de83c31a053 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:16.800683 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-187ae9f7-ddc7-4c2f-9e6c-1de83c31a053 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:16.801348 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-187ae9f7-ddc7-4c2f-9e6c-1de83c31a053 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:16.802059 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-187ae9f7-ddc7-4c2f-9e6c-1de83c31a053 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:16.802530 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-187ae9f7-ddc7-4c2f-9e6c-1de83c31a053 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:16.802926 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-187ae9f7-ddc7-4c2f-9e6c-1de83c31a053 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:17.100587 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-187ae9f7-ddc7-4c2f-9e6c-1de83c31a053 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:17.103346 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-39edc1f1-ee7e-4bab-a055-5ce41a9e87c2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:17.104570 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-39edc1f1-ee7e-4bab-a055-5ce41a9e87c2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:17.109128 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-187ae9f7-ddc7-4c2f-9e6c-1de83c31a053 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.323564 Sep 06 16:18:17.110038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 178/361] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:16 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:17.110503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=48 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:17.118031 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39edc1f1-ee7e-4bab-a055-5ce41a9e87c2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:17.118523 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39edc1f1-ee7e-4bab-a055-5ce41a9e87c2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:17.118948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39edc1f1-ee7e-4bab-a055-5ce41a9e87c2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:17.119641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39edc1f1-ee7e-4bab-a055-5ce41a9e87c2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:17.120081 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39edc1f1-ee7e-4bab-a055-5ce41a9e87c2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:17.120495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39edc1f1-ee7e-4bab-a055-5ce41a9e87c2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:17.121611 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-db9c685b-3510-44a3-8871-6476eecca86c tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Action: 'create', calling method: .version_select at 0x7f83e988edc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-651954085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9tLSehGp4FkhivV85b6A+auqM3OLUpRBVXnqa179jEU5OQKusjXwVfX1rzwpazrhcGKqUdoS6B6jjZcp0NNTJfxzmhcJUGntJKlnQwfXgj/vsp+tBhHCYHxV0qJcsrNA=="}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:17.142143 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-db9c685b-3510-44a3-8871-6476eecca86c tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Getting quotas for project 04bbe101d7ac40ab995da2159f3105cd. Resources: {'key_pairs'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:18:17.146214 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-db9c685b-3510-44a3-8871-6476eecca86c tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Getting quotas for user bbe4c1ecf08f4dd5a005f883c16c6a62 and project 04bbe101d7ac40ab995da2159f3105cd. Resources: {'key_pairs'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:18:17.183457 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-db9c685b-3510-44a3-8871-6476eecca86c tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.065581 Sep 06 16:18:17.184237 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 179/362] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 6 16:18:17 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:17.237860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1330391365", "imageRef": "5b55bff0-57e9-447a-adda-fc68d259747d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-651954085", "networks": [{"uuid": "65d49193-6cbe-49fe-a11e-655a4ee48c7a"}]}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:17.313156 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] validate_networks() for [('65d49193-6cbe-49fe-a11e-655a4ee48c7a', None, None, None, None, None)] {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:18:17.506112 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-39edc1f1-ee7e-4bab-a055-5ce41a9e87c2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:17.514873 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-39edc1f1-ee7e-4bab-a055-5ce41a9e87c2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.415580 Sep 06 16:18:17.515457 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 184/363] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:17 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:17.742426 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:18:17.743195 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:18:17.744074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:18:17.744806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:18:17.745556 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:18:17.761502 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:17.762361 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:17.763087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:17.764478 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:17.765395 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:17.766201 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:17.802809 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Getting quotas for project 04bbe101d7ac40ab995da2159f3105cd. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:18:17.808223 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Getting quotas for user bbe4c1ecf08f4dd5a005f883c16c6a62 and project 04bbe101d7ac40ab995da2159f3105cd. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:18:17.828803 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:18:17.831110 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b55bff0-57e9-447a-adda-fc68d259747d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:18:17.884840 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-599acef2-a155-477b-ab22-9cdf91664f0d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650951 Sep 06 16:18:17.895518 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 180/364] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:18:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 16:18:17.900941 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-89b77eae-2af2-4577-b5c5-b1459f8441d5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:17.901568 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-89b77eae-2af2-4577-b5c5-b1459f8441d5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:17.962285 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-89b77eae-2af2-4577-b5c5-b1459f8441d5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:17.974910 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-89b77eae-2af2-4577-b5c5-b1459f8441d5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1258 microversion: 2.1 time: 0.077905 Sep 06 16:18:17.975636 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 185/365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:17 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:18.137762 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c4847eb5-dae5-49c6-bfd6-87af89e66e7f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:18.138721 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c4847eb5-dae5-49c6-bfd6-87af89e66e7f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:18.146231 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c4847eb5-dae5-49c6-bfd6-87af89e66e7f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:18.146728 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c4847eb5-dae5-49c6-bfd6-87af89e66e7f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:18.147170 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c4847eb5-dae5-49c6-bfd6-87af89e66e7f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:18.147885 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c4847eb5-dae5-49c6-bfd6-87af89e66e7f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:18.148348 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c4847eb5-dae5-49c6-bfd6-87af89e66e7f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:18.148846 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c4847eb5-dae5-49c6-bfd6-87af89e66e7f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:18.316675 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c4847eb5-dae5-49c6-bfd6-87af89e66e7f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:18.326611 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c4847eb5-dae5-49c6-bfd6-87af89e66e7f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.195854 Sep 06 16:18:18.327568 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 181/366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:18 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:18.544866 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7a6859ca-3762-49c1-901c-5ff7dd6a98da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:18.546331 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7a6859ca-3762-49c1-901c-5ff7dd6a98da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:18.558217 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7a6859ca-3762-49c1-901c-5ff7dd6a98da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:18.559203 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7a6859ca-3762-49c1-901c-5ff7dd6a98da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:18.559975 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7a6859ca-3762-49c1-901c-5ff7dd6a98da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:18.562059 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7a6859ca-3762-49c1-901c-5ff7dd6a98da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:18.562907 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7a6859ca-3762-49c1-901c-5ff7dd6a98da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:18.563651 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7a6859ca-3762-49c1-901c-5ff7dd6a98da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:18.736657 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7a6859ca-3762-49c1-901c-5ff7dd6a98da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:18.745902 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7a6859ca-3762-49c1-901c-5ff7dd6a98da tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.208907 Sep 06 16:18:18.746496 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 186/367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:18 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:19.000050 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6ebb88fa-3ed1-4cc3-83b8-61108f212ca1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:19.000664 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6ebb88fa-3ed1-4cc3-83b8-61108f212ca1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:19.007539 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ebb88fa-3ed1-4cc3-83b8-61108f212ca1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:19.008024 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ebb88fa-3ed1-4cc3-83b8-61108f212ca1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:19.008477 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ebb88fa-3ed1-4cc3-83b8-61108f212ca1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:19.009193 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ebb88fa-3ed1-4cc3-83b8-61108f212ca1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:19.009652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ebb88fa-3ed1-4cc3-83b8-61108f212ca1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:19.010138 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ebb88fa-3ed1-4cc3-83b8-61108f212ca1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:19.077718 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6ebb88fa-3ed1-4cc3-83b8-61108f212ca1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:19.081534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:19.086445 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6ebb88fa-3ed1-4cc3-83b8-61108f212ca1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1262 microversion: 2.1 time: 0.090531 Sep 06 16:18:19.087006 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 182/368] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:18 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:19.355322 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-05121ee8-e1f3-4f56-bdf4-5d8689ab9595 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:19.355931 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-05121ee8-e1f3-4f56-bdf4-5d8689ab9595 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:19.362522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-05121ee8-e1f3-4f56-bdf4-5d8689ab9595 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:19.363007 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-05121ee8-e1f3-4f56-bdf4-5d8689ab9595 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:19.363633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-05121ee8-e1f3-4f56-bdf4-5d8689ab9595 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:19.364338 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-05121ee8-e1f3-4f56-bdf4-5d8689ab9595 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:19.364796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-05121ee8-e1f3-4f56-bdf4-5d8689ab9595 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:19.365221 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-05121ee8-e1f3-4f56-bdf4-5d8689ab9595 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:19.515707 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-05121ee8-e1f3-4f56-bdf4-5d8689ab9595 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:19.525120 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-05121ee8-e1f3-4f56-bdf4-5d8689ab9595 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.174157 Sep 06 16:18:19.530008 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 187/369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:19 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:19.771430 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4d24c50c-83ef-43c0-8f31-b2f1d1ad6474 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:19.772142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4d24c50c-83ef-43c0-8f31-b2f1d1ad6474 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:19.779776 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4d24c50c-83ef-43c0-8f31-b2f1d1ad6474 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:19.780563 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4d24c50c-83ef-43c0-8f31-b2f1d1ad6474 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:19.781436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4d24c50c-83ef-43c0-8f31-b2f1d1ad6474 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:19.782529 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4d24c50c-83ef-43c0-8f31-b2f1d1ad6474 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:19.782986 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4d24c50c-83ef-43c0-8f31-b2f1d1ad6474 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:19.783456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4d24c50c-83ef-43c0-8f31-b2f1d1ad6474 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:19.943545 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4d24c50c-83ef-43c0-8f31-b2f1d1ad6474 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:19.955872 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4d24c50c-83ef-43c0-8f31-b2f1d1ad6474 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.188958 Sep 06 16:18:19.971836 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 183/370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:19 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:20.109489 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f5fc2dbe-55fb-4371-b60d-69c5f3c1f010 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:20.110102 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f5fc2dbe-55fb-4371-b60d-69c5f3c1f010 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:20.116660 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5fc2dbe-55fb-4371-b60d-69c5f3c1f010 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:20.117186 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5fc2dbe-55fb-4371-b60d-69c5f3c1f010 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:20.117619 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5fc2dbe-55fb-4371-b60d-69c5f3c1f010 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:20.118346 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5fc2dbe-55fb-4371-b60d-69c5f3c1f010 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:20.118799 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5fc2dbe-55fb-4371-b60d-69c5f3c1f010 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:20.119213 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5fc2dbe-55fb-4371-b60d-69c5f3c1f010 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:20.190245 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f5fc2dbe-55fb-4371-b60d-69c5f3c1f010 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:20.193879 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:20.198764 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f5fc2dbe-55fb-4371-b60d-69c5f3c1f010 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1262 microversion: 2.1 time: 0.093457 Sep 06 16:18:20.199333 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 188/371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:20 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:20.561774 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-60fb886e-4007-4d72-9574-6bee9c7eddb3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:20.562344 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-60fb886e-4007-4d72-9574-6bee9c7eddb3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:20.569301 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-60fb886e-4007-4d72-9574-6bee9c7eddb3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:20.569789 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-60fb886e-4007-4d72-9574-6bee9c7eddb3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:20.570225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-60fb886e-4007-4d72-9574-6bee9c7eddb3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:20.570930 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-60fb886e-4007-4d72-9574-6bee9c7eddb3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:20.571380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-60fb886e-4007-4d72-9574-6bee9c7eddb3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:20.571804 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-60fb886e-4007-4d72-9574-6bee9c7eddb3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:20.713265 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-60fb886e-4007-4d72-9574-6bee9c7eddb3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:20.721459 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-60fb886e-4007-4d72-9574-6bee9c7eddb3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.164008 Sep 06 16:18:20.722035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 184/372] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:20 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:20.995437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-66e6a4a0-12cd-4863-ae7e-4fd685b22531 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:20.996006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-66e6a4a0-12cd-4863-ae7e-4fd685b22531 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:21.002926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-66e6a4a0-12cd-4863-ae7e-4fd685b22531 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:21.003462 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-66e6a4a0-12cd-4863-ae7e-4fd685b22531 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:21.003874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-66e6a4a0-12cd-4863-ae7e-4fd685b22531 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:21.004594 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-66e6a4a0-12cd-4863-ae7e-4fd685b22531 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:21.005021 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-66e6a4a0-12cd-4863-ae7e-4fd685b22531 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:21.005449 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-66e6a4a0-12cd-4863-ae7e-4fd685b22531 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:21.163472 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-66e6a4a0-12cd-4863-ae7e-4fd685b22531 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:21.172254 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-66e6a4a0-12cd-4863-ae7e-4fd685b22531 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.181717 Sep 06 16:18:21.173458 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 189/373] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:20 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:21.221887 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-984fb287-96e3-4e9e-acfa-176483bb6b45 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:21.222489 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-984fb287-96e3-4e9e-acfa-176483bb6b45 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:21.228791 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-984fb287-96e3-4e9e-acfa-176483bb6b45 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:21.229490 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-984fb287-96e3-4e9e-acfa-176483bb6b45 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:21.229924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-984fb287-96e3-4e9e-acfa-176483bb6b45 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:21.230604 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-984fb287-96e3-4e9e-acfa-176483bb6b45 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:21.231043 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-984fb287-96e3-4e9e-acfa-176483bb6b45 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:21.231515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-984fb287-96e3-4e9e-acfa-176483bb6b45 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:21.305043 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-984fb287-96e3-4e9e-acfa-176483bb6b45 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:21.313436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-984fb287-96e3-4e9e-acfa-176483bb6b45 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1262 microversion: 2.1 time: 0.095588 Sep 06 16:18:21.313995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 185/374] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:21 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1262 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:21.747028 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-35cd0ecb-c67c-4b6d-8cdd-4b2d485ea98c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:21.747654 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-35cd0ecb-c67c-4b6d-8cdd-4b2d485ea98c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:21.754587 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35cd0ecb-c67c-4b6d-8cdd-4b2d485ea98c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:21.755079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35cd0ecb-c67c-4b6d-8cdd-4b2d485ea98c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:21.755509 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35cd0ecb-c67c-4b6d-8cdd-4b2d485ea98c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:21.756204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35cd0ecb-c67c-4b6d-8cdd-4b2d485ea98c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:21.756656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35cd0ecb-c67c-4b6d-8cdd-4b2d485ea98c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:21.757102 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35cd0ecb-c67c-4b6d-8cdd-4b2d485ea98c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:21.919830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-35cd0ecb-c67c-4b6d-8cdd-4b2d485ea98c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:21.927914 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-35cd0ecb-c67c-4b6d-8cdd-4b2d485ea98c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.184816 Sep 06 16:18:21.928589 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 190/375] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:21 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:22.198420 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6740d338-0ae0-4427-967b-dd2a416da430 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:22.199143 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6740d338-0ae0-4427-967b-dd2a416da430 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:22.206223 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6740d338-0ae0-4427-967b-dd2a416da430 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:22.206832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6740d338-0ae0-4427-967b-dd2a416da430 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:22.207582 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6740d338-0ae0-4427-967b-dd2a416da430 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:22.208476 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6740d338-0ae0-4427-967b-dd2a416da430 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:22.209076 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6740d338-0ae0-4427-967b-dd2a416da430 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:22.209704 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6740d338-0ae0-4427-967b-dd2a416da430 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:22.339521 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-16c2ae7f-5012-426f-9771-6ad39779dca5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:22.340406 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-16c2ae7f-5012-426f-9771-6ad39779dca5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:22.346651 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-16c2ae7f-5012-426f-9771-6ad39779dca5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:22.347231 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-16c2ae7f-5012-426f-9771-6ad39779dca5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:22.347729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-16c2ae7f-5012-426f-9771-6ad39779dca5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:22.348513 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-16c2ae7f-5012-426f-9771-6ad39779dca5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:22.349210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-16c2ae7f-5012-426f-9771-6ad39779dca5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:22.349733 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-16c2ae7f-5012-426f-9771-6ad39779dca5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:22.356164 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6740d338-0ae0-4427-967b-dd2a416da430 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:22.364875 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6740d338-0ae0-4427-967b-dd2a416da430 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.172560 Sep 06 16:18:22.365443 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 186/376] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:22 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:22.416833 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-16c2ae7f-5012-426f-9771-6ad39779dca5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:22.425462 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-16c2ae7f-5012-426f-9771-6ad39779dca5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1262 microversion: 2.1 time: 0.090510 Sep 06 16:18:22.426021 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 191/377] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:22 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:22.951818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a66ca17e-4ff8-4958-a5ee-47096a791525 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:22.952544 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a66ca17e-4ff8-4958-a5ee-47096a791525 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:22.959007 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a66ca17e-4ff8-4958-a5ee-47096a791525 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:22.959504 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a66ca17e-4ff8-4958-a5ee-47096a791525 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:22.959937 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a66ca17e-4ff8-4958-a5ee-47096a791525 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:22.960642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a66ca17e-4ff8-4958-a5ee-47096a791525 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:22.961128 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a66ca17e-4ff8-4958-a5ee-47096a791525 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:22.961557 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a66ca17e-4ff8-4958-a5ee-47096a791525 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:23.094735 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a66ca17e-4ff8-4958-a5ee-47096a791525 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:23.102769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a66ca17e-4ff8-4958-a5ee-47096a791525 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.155084 Sep 06 16:18:23.103353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 187/378] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:22 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:23.388044 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-746c5de4-65f5-4d9c-9f65-4da174326d06 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:23.388653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-746c5de4-65f5-4d9c-9f65-4da174326d06 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:23.395113 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-746c5de4-65f5-4d9c-9f65-4da174326d06 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:23.395673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-746c5de4-65f5-4d9c-9f65-4da174326d06 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:23.396151 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-746c5de4-65f5-4d9c-9f65-4da174326d06 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:23.396914 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-746c5de4-65f5-4d9c-9f65-4da174326d06 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:23.397498 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-746c5de4-65f5-4d9c-9f65-4da174326d06 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:23.398105 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-746c5de4-65f5-4d9c-9f65-4da174326d06 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:23.448852 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-96cda542-bb24-40ea-b0d1-ec07297b13f7 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:23.449469 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-96cda542-bb24-40ea-b0d1-ec07297b13f7 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:23.456215 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-96cda542-bb24-40ea-b0d1-ec07297b13f7 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:23.456692 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-96cda542-bb24-40ea-b0d1-ec07297b13f7 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:23.457150 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-96cda542-bb24-40ea-b0d1-ec07297b13f7 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:23.457818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-96cda542-bb24-40ea-b0d1-ec07297b13f7 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:23.458287 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-96cda542-bb24-40ea-b0d1-ec07297b13f7 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:23.458670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-96cda542-bb24-40ea-b0d1-ec07297b13f7 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:23.524835 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-96cda542-bb24-40ea-b0d1-ec07297b13f7 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:23.533290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-96cda542-bb24-40ea-b0d1-ec07297b13f7 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1262 microversion: 2.1 time: 0.088171 Sep 06 16:18:23.534163 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 188/379] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:23 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:23.544971 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-746c5de4-65f5-4d9c-9f65-4da174326d06 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:23.553827 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-746c5de4-65f5-4d9c-9f65-4da174326d06 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.169925 Sep 06 16:18:23.554509 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 192/380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:23 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:24.126361 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-78f07843-38ff-4d18-9c89-b09b273084cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:24.126969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-78f07843-38ff-4d18-9c89-b09b273084cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:24.145482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78f07843-38ff-4d18-9c89-b09b273084cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:24.146318 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78f07843-38ff-4d18-9c89-b09b273084cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:24.147072 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78f07843-38ff-4d18-9c89-b09b273084cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:24.148330 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78f07843-38ff-4d18-9c89-b09b273084cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:24.149228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78f07843-38ff-4d18-9c89-b09b273084cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:24.149973 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78f07843-38ff-4d18-9c89-b09b273084cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:24.292366 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-78f07843-38ff-4d18-9c89-b09b273084cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:24.300783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-78f07843-38ff-4d18-9c89-b09b273084cb tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.178393 Sep 06 16:18:24.301325 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 189/381] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:24 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:24.555663 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e4ddfa7e-1eea-4558-b03f-2d33d31e1237 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:24.556271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e4ddfa7e-1eea-4558-b03f-2d33d31e1237 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:24.569126 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4ddfa7e-1eea-4558-b03f-2d33d31e1237 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:24.569617 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4ddfa7e-1eea-4558-b03f-2d33d31e1237 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:24.570053 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4ddfa7e-1eea-4558-b03f-2d33d31e1237 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:24.570754 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4ddfa7e-1eea-4558-b03f-2d33d31e1237 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:24.571202 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4ddfa7e-1eea-4558-b03f-2d33d31e1237 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:24.571620 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4ddfa7e-1eea-4558-b03f-2d33d31e1237 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:24.579959 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-869089e9-de45-4f4f-bb8f-9c15128837b1 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:24.580707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-869089e9-de45-4f4f-bb8f-9c15128837b1 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:24.587642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-869089e9-de45-4f4f-bb8f-9c15128837b1 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:24.588138 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-869089e9-de45-4f4f-bb8f-9c15128837b1 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:24.588628 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-869089e9-de45-4f4f-bb8f-9c15128837b1 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:24.589349 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-869089e9-de45-4f4f-bb8f-9c15128837b1 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:24.589843 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-869089e9-de45-4f4f-bb8f-9c15128837b1 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:24.590257 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-869089e9-de45-4f4f-bb8f-9c15128837b1 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:24.638009 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e4ddfa7e-1eea-4558-b03f-2d33d31e1237 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:24.646446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e4ddfa7e-1eea-4558-b03f-2d33d31e1237 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1254 microversion: 2.1 time: 0.094592 Sep 06 16:18:24.647023 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 193/382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:24 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1254 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:24.733192 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-869089e9-de45-4f4f-bb8f-9c15128837b1 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:24.746460 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-869089e9-de45-4f4f-bb8f-9c15128837b1 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.170573 Sep 06 16:18:24.747285 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 190/383] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:24 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:25.323175 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-36ce035f-87ad-4e7c-b145-f7e285f5bec9 req-62020416-ab1e-4086-9b35-3aa02a90cbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449e6106-faac-4d42-b021-674742c4d201", "name": "network-vif-plugged", "status": "completed", "tag": "d19f49a2-3073-4f0d-88df-4536fe68481f"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:25.327023 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4327a3ba-3e6c-46e6-ad95-8204953d90d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:25.328218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4327a3ba-3e6c-46e6-ad95-8204953d90d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:25.337485 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4327a3ba-3e6c-46e6-ad95-8204953d90d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:25.338003 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4327a3ba-3e6c-46e6-ad95-8204953d90d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:25.338475 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4327a3ba-3e6c-46e6-ad95-8204953d90d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:25.339189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4327a3ba-3e6c-46e6-ad95-8204953d90d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:25.339641 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4327a3ba-3e6c-46e6-ad95-8204953d90d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:25.340068 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4327a3ba-3e6c-46e6-ad95-8204953d90d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:25.343866 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-36ce035f-87ad-4e7c-b145-f7e285f5bec9 req-62020416-ab1e-4086-9b35-3aa02a90cbd2 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:25.344634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-36ce035f-87ad-4e7c-b145-f7e285f5bec9 req-62020416-ab1e-4086-9b35-3aa02a90cbd2 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:25.345831 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-36ce035f-87ad-4e7c-b145-f7e285f5bec9 req-62020416-ab1e-4086-9b35-3aa02a90cbd2 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:25.383412 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-36ce035f-87ad-4e7c-b145-f7e285f5bec9 req-62020416-ab1e-4086-9b35-3aa02a90cbd2 service nova] Creating event network-vif-plugged:d19f49a2-3073-4f0d-88df-4536fe68481f for instance 449e6106-faac-4d42-b021-674742c4d201 on hv-cinder-85221 Sep 06 16:18:25.407197 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-36ce035f-87ad-4e7c-b145-f7e285f5bec9 req-62020416-ab1e-4086-9b35-3aa02a90cbd2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091069 Sep 06 16:18:25.408329 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 194/384] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:25.518939 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4327a3ba-3e6c-46e6-ad95-8204953d90d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:25.526999 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4327a3ba-3e6c-46e6-ad95-8204953d90d7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.206358 Sep 06 16:18:25.527583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 191/385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:25 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:25.670636 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-91398f5e-3af8-449b-b324-44bf3445d29b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:25.671353 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-91398f5e-3af8-449b-b324-44bf3445d29b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:25.677918 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-91398f5e-3af8-449b-b324-44bf3445d29b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:25.678401 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-91398f5e-3af8-449b-b324-44bf3445d29b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:25.678835 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-91398f5e-3af8-449b-b324-44bf3445d29b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:25.679542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-91398f5e-3af8-449b-b324-44bf3445d29b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:25.679994 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-91398f5e-3af8-449b-b324-44bf3445d29b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:25.680423 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-91398f5e-3af8-449b-b324-44bf3445d29b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:25.750430 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-91398f5e-3af8-449b-b324-44bf3445d29b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:25.758555 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-91398f5e-3af8-449b-b324-44bf3445d29b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1310 microversion: 2.1 time: 0.092010 Sep 06 16:18:25.759129 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 195/386] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:25 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:25.777954 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-100f0071-2171-4611-a6aa-cc5201d48c71 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:25.778746 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-100f0071-2171-4611-a6aa-cc5201d48c71 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:25.785341 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-100f0071-2171-4611-a6aa-cc5201d48c71 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:25.785826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-100f0071-2171-4611-a6aa-cc5201d48c71 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:25.786330 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-100f0071-2171-4611-a6aa-cc5201d48c71 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:25.786939 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-100f0071-2171-4611-a6aa-cc5201d48c71 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:25.787452 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-100f0071-2171-4611-a6aa-cc5201d48c71 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:25.787879 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-100f0071-2171-4611-a6aa-cc5201d48c71 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:25.942775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-100f0071-2171-4611-a6aa-cc5201d48c71 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:25.950648 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-100f0071-2171-4611-a6aa-cc5201d48c71 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.176828 Sep 06 16:18:25.951295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 192/387] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:25 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:26.553685 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f4734cf2-5022-4f46-a5a2-89f6f3ca1461 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:26.554438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f4734cf2-5022-4f46-a5a2-89f6f3ca1461 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:26.561946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f4734cf2-5022-4f46-a5a2-89f6f3ca1461 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:26.562602 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f4734cf2-5022-4f46-a5a2-89f6f3ca1461 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:26.563166 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f4734cf2-5022-4f46-a5a2-89f6f3ca1461 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:26.564451 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f4734cf2-5022-4f46-a5a2-89f6f3ca1461 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:26.565442 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f4734cf2-5022-4f46-a5a2-89f6f3ca1461 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:26.566035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f4734cf2-5022-4f46-a5a2-89f6f3ca1461 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:26.763664 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f4734cf2-5022-4f46-a5a2-89f6f3ca1461 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:26.776966 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f4734cf2-5022-4f46-a5a2-89f6f3ca1461 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1522 microversion: 2.1 time: 0.226120 Sep 06 16:18:26.776966 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 196/388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:26 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:26.783794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-82d29430-cbc7-47a1-bc80-a961e8902b39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:26.784516 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-82d29430-cbc7-47a1-bc80-a961e8902b39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:26.797533 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82d29430-cbc7-47a1-bc80-a961e8902b39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:26.798265 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82d29430-cbc7-47a1-bc80-a961e8902b39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:26.798902 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82d29430-cbc7-47a1-bc80-a961e8902b39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:26.799874 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82d29430-cbc7-47a1-bc80-a961e8902b39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:26.800343 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82d29430-cbc7-47a1-bc80-a961e8902b39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:26.800811 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82d29430-cbc7-47a1-bc80-a961e8902b39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:26.918272 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-82d29430-cbc7-47a1-bc80-a961e8902b39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:26.928523 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-82d29430-cbc7-47a1-bc80-a961e8902b39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1310 microversion: 2.1 time: 0.148668 Sep 06 16:18:26.931926 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 193/389] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:26 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1310 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:26.975676 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4b5c3e65-5401-4fb4-9a5a-f72094c89145 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:26.976345 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4b5c3e65-5401-4fb4-9a5a-f72094c89145 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:26.982480 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4b5c3e65-5401-4fb4-9a5a-f72094c89145 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:26.982973 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4b5c3e65-5401-4fb4-9a5a-f72094c89145 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:26.983397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4b5c3e65-5401-4fb4-9a5a-f72094c89145 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:26.984279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4b5c3e65-5401-4fb4-9a5a-f72094c89145 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:26.984816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4b5c3e65-5401-4fb4-9a5a-f72094c89145 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:26.985342 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4b5c3e65-5401-4fb4-9a5a-f72094c89145 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:27.147180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4b5c3e65-5401-4fb4-9a5a-f72094c89145 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:27.167735 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4b5c3e65-5401-4fb4-9a5a-f72094c89145 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.196033 Sep 06 16:18:27.168521 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 197/390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:26 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:27.799410 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c2e5b9a2-1635-42ec-9c59-0e910910bca9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:27.800019 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c2e5b9a2-1635-42ec-9c59-0e910910bca9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:27.802006 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:27.803145 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:27.809128 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c2e5b9a2-1635-42ec-9c59-0e910910bca9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:27.809619 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c2e5b9a2-1635-42ec-9c59-0e910910bca9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:27.810056 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c2e5b9a2-1635-42ec-9c59-0e910910bca9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:27.811119 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c2e5b9a2-1635-42ec-9c59-0e910910bca9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:27.811546 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c2e5b9a2-1635-42ec-9c59-0e910910bca9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:27.811988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c2e5b9a2-1635-42ec-9c59-0e910910bca9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:27.817804 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=10 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:27.960109 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1065a765-bbe5-4e17-a113-a485aac0f0fb tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:27.961696 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1065a765-bbe5-4e17-a113-a485aac0f0fb tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:27.969925 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1065a765-bbe5-4e17-a113-a485aac0f0fb tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:27.970267 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c2e5b9a2-1635-42ec-9c59-0e910910bca9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:27.971155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1065a765-bbe5-4e17-a113-a485aac0f0fb tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:27.971774 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1065a765-bbe5-4e17-a113-a485aac0f0fb tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:27.972994 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1065a765-bbe5-4e17-a113-a485aac0f0fb tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:27.973505 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1065a765-bbe5-4e17-a113-a485aac0f0fb tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:27.974145 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1065a765-bbe5-4e17-a113-a485aac0f0fb tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:27.975236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:27.980734 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c2e5b9a2-1635-42ec-9c59-0e910910bca9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1502 microversion: 2.1 time: 0.184987 Sep 06 16:18:27.998033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 194/391] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:27 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1502 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:28.007799 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-56908de0-8586-45a6-968d-d7ab2a27a653 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:28.008420 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-56908de0-8586-45a6-968d-d7ab2a27a653 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:28.016100 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-56908de0-8586-45a6-968d-d7ab2a27a653 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:28.016586 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-56908de0-8586-45a6-968d-d7ab2a27a653 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:28.017044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-56908de0-8586-45a6-968d-d7ab2a27a653 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:28.017778 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-56908de0-8586-45a6-968d-d7ab2a27a653 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:28.018393 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-56908de0-8586-45a6-968d-d7ab2a27a653 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:28.018815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-56908de0-8586-45a6-968d-d7ab2a27a653 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:28.051562 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1065a765-bbe5-4e17-a113-a485aac0f0fb tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:28.060443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1065a765-bbe5-4e17-a113-a485aac0f0fb tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1318 microversion: 2.1 time: 0.104699 Sep 06 16:18:28.061808 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 198/392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:27 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1318 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:28.194500 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ef24fe76-0f34-44c1-9d55-5f0b030d40b2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:28.195309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ef24fe76-0f34-44c1-9d55-5f0b030d40b2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:28.197462 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-56908de0-8586-45a6-968d-d7ab2a27a653 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:28.202700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ef24fe76-0f34-44c1-9d55-5f0b030d40b2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:28.203210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ef24fe76-0f34-44c1-9d55-5f0b030d40b2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:28.203641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ef24fe76-0f34-44c1-9d55-5f0b030d40b2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:28.204376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ef24fe76-0f34-44c1-9d55-5f0b030d40b2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:28.204857 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ef24fe76-0f34-44c1-9d55-5f0b030d40b2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:28.205736 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ef24fe76-0f34-44c1-9d55-5f0b030d40b2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:28.209842 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-56908de0-8586-45a6-968d-d7ab2a27a653 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1517 microversion: 2.1 time: 0.209396 Sep 06 16:18:28.210527 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 195/393] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:27 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:28.389835 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ef24fe76-0f34-44c1-9d55-5f0b030d40b2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:28.398946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ef24fe76-0f34-44c1-9d55-5f0b030d40b2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.208728 Sep 06 16:18:28.399890 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 199/394] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:28 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:29.086275 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0d3c1b77-9f7d-4ceb-8946-c0fd8fb66381 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:29.087525 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0d3c1b77-9f7d-4ceb-8946-c0fd8fb66381 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:29.097906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d3c1b77-9f7d-4ceb-8946-c0fd8fb66381 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:29.098878 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d3c1b77-9f7d-4ceb-8946-c0fd8fb66381 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:29.099682 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d3c1b77-9f7d-4ceb-8946-c0fd8fb66381 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:29.100977 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d3c1b77-9f7d-4ceb-8946-c0fd8fb66381 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:29.102599 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d3c1b77-9f7d-4ceb-8946-c0fd8fb66381 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:29.103257 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d3c1b77-9f7d-4ceb-8946-c0fd8fb66381 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:29.352622 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0d3c1b77-9f7d-4ceb-8946-c0fd8fb66381 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:29.363365 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0d3c1b77-9f7d-4ceb-8946-c0fd8fb66381 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1316 microversion: 2.1 time: 0.281675 Sep 06 16:18:29.364058 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 196/395] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:29 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:29.437184 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-8523f132-6c91-4121-bf5d-fb171335f532 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:29.441545 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-8523f132-6c91-4121-bf5d-fb171335f532 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:29.462534 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8523f132-6c91-4121-bf5d-fb171335f532 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:29.471113 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8523f132-6c91-4121-bf5d-fb171335f532 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:29.471591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8523f132-6c91-4121-bf5d-fb171335f532 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:29.472492 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8523f132-6c91-4121-bf5d-fb171335f532 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:29.472849 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8523f132-6c91-4121-bf5d-fb171335f532 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:29.473322 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8523f132-6c91-4121-bf5d-fb171335f532 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:29.652391 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8523f132-6c91-4121-bf5d-fb171335f532 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:29.661080 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-8523f132-6c91-4121-bf5d-fb171335f532 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1313 microversion: 2.1 time: 0.230555 Sep 06 16:18:29.662356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 200/396] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:29 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:29.712536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0192b0b4-4883-4c4c-a898-b60231b227cf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:29.715054 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0192b0b4-4883-4c4c-a898-b60231b227cf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:29.723177 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0192b0b4-4883-4c4c-a898-b60231b227cf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:29.723663 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0192b0b4-4883-4c4c-a898-b60231b227cf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:29.724286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0192b0b4-4883-4c4c-a898-b60231b227cf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:29.725041 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0192b0b4-4883-4c4c-a898-b60231b227cf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:29.725551 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0192b0b4-4883-4c4c-a898-b60231b227cf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:29.726172 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0192b0b4-4883-4c4c-a898-b60231b227cf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:29.752071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-0192b0b4-4883-4c4c-a898-b60231b227cf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lazy-loading 'flavor' on Instance uuid 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:18:29.855031 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:29.878475 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0192b0b4-4883-4c4c-a898-b60231b227cf tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "POST /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9/action" status: 200 len: 32 microversion: 2.1 time: 0.169937 Sep 06 16:18:29.879088 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 197/397] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:18:29 2022] POST /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:18:29.889692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d142b70e-a6d5-4b77-8d2e-82a0f0fee36d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:29.890463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d142b70e-a6d5-4b77-8d2e-82a0f0fee36d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:29.898045 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d142b70e-a6d5-4b77-8d2e-82a0f0fee36d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:29.898690 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d142b70e-a6d5-4b77-8d2e-82a0f0fee36d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:29.899238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d142b70e-a6d5-4b77-8d2e-82a0f0fee36d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:29.900021 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d142b70e-a6d5-4b77-8d2e-82a0f0fee36d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:29.900542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d142b70e-a6d5-4b77-8d2e-82a0f0fee36d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:29.901233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d142b70e-a6d5-4b77-8d2e-82a0f0fee36d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:30.101560 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d142b70e-a6d5-4b77-8d2e-82a0f0fee36d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:30.113397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d142b70e-a6d5-4b77-8d2e-82a0f0fee36d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.228202 Sep 06 16:18:30.114043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 201/398] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:29 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:30.390498 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-57b0c567-bfc5-44f1-bd0b-3f19e1216afc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:30.391210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-57b0c567-bfc5-44f1-bd0b-3f19e1216afc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:30.404634 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57b0c567-bfc5-44f1-bd0b-3f19e1216afc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:30.405231 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57b0c567-bfc5-44f1-bd0b-3f19e1216afc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:30.405724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57b0c567-bfc5-44f1-bd0b-3f19e1216afc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:30.406644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57b0c567-bfc5-44f1-bd0b-3f19e1216afc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:30.407308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57b0c567-bfc5-44f1-bd0b-3f19e1216afc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:30.408017 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57b0c567-bfc5-44f1-bd0b-3f19e1216afc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:30.698149 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0b70f142-02f5-498c-b0f0-42c63c4c3694 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:30.699612 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0b70f142-02f5-498c-b0f0-42c63c4c3694 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:30.714731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b70f142-02f5-498c-b0f0-42c63c4c3694 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:30.717747 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b70f142-02f5-498c-b0f0-42c63c4c3694 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:30.718210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b70f142-02f5-498c-b0f0-42c63c4c3694 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:30.725801 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b70f142-02f5-498c-b0f0-42c63c4c3694 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:30.726337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b70f142-02f5-498c-b0f0-42c63c4c3694 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:30.728684 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b70f142-02f5-498c-b0f0-42c63c4c3694 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:31.089281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0b70f142-02f5-498c-b0f0-42c63c4c3694 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:31.116309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0b70f142-02f5-498c-b0f0-42c63c4c3694 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1496 microversion: 2.1 time: 0.433874 Sep 06 16:18:31.118269 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 202/399] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:30 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1496 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:31.151334 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-91d6c152-de19-4220-b36b-2538fcef736c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:31.156051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-91d6c152-de19-4220-b36b-2538fcef736c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:31.179716 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-91d6c152-de19-4220-b36b-2538fcef736c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:31.180827 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-91d6c152-de19-4220-b36b-2538fcef736c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:31.181432 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-91d6c152-de19-4220-b36b-2538fcef736c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:31.182559 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-91d6c152-de19-4220-b36b-2538fcef736c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:31.183675 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-91d6c152-de19-4220-b36b-2538fcef736c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:31.184459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-91d6c152-de19-4220-b36b-2538fcef736c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:31.665089 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-91d6c152-de19-4220-b36b-2538fcef736c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:31.678023 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-57b0c567-bfc5-44f1-bd0b-3f19e1216afc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:31.680018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-91d6c152-de19-4220-b36b-2538fcef736c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.539046 Sep 06 16:18:31.681479 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 203/400] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:31 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:31.704178 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-57b0c567-bfc5-44f1-bd0b-3f19e1216afc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 1.318454 Sep 06 16:18:31.744499 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 198/401] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:30 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:32.307310 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-35f9491c-c971-471e-9f9c-88ef260b483e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:32.308251 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-35f9491c-c971-471e-9f9c-88ef260b483e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:32.326296 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35f9491c-c971-471e-9f9c-88ef260b483e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:32.333873 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35f9491c-c971-471e-9f9c-88ef260b483e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:32.335189 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35f9491c-c971-471e-9f9c-88ef260b483e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:32.337013 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35f9491c-c971-471e-9f9c-88ef260b483e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:32.338108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35f9491c-c971-471e-9f9c-88ef260b483e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:32.339105 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35f9491c-c971-471e-9f9c-88ef260b483e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:32.397844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-35f9491c-c971-471e-9f9c-88ef260b483e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Going to try to terminate instance {{(pid=120668) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:18:32.586561 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:32.693442 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-35f9491c-c971-471e-9f9c-88ef260b483e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "DELETE /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 204 len: 0 microversion: 2.1 time: 0.393542 Sep 06 16:18:32.697145 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 204/402] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:18:32 2022] DELETE /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:18:32.712948 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-10205afc-ca86-41ee-be40-55e43c082fe5 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:32.715809 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-10205afc-ca86-41ee-be40-55e43c082fe5 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:32.729035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10205afc-ca86-41ee-be40-55e43c082fe5 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:32.730007 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10205afc-ca86-41ee-be40-55e43c082fe5 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:32.730606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10205afc-ca86-41ee-be40-55e43c082fe5 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:32.731643 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10205afc-ca86-41ee-be40-55e43c082fe5 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:32.732255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10205afc-ca86-41ee-be40-55e43c082fe5 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:32.733159 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10205afc-ca86-41ee-be40-55e43c082fe5 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:32.733891 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a59f2a6e-2f7f-4123-ab77-b72f21dd95e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:32.739254 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a59f2a6e-2f7f-4123-ab77-b72f21dd95e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:32.783721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a59f2a6e-2f7f-4123-ab77-b72f21dd95e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:32.786875 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a59f2a6e-2f7f-4123-ab77-b72f21dd95e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:32.788009 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a59f2a6e-2f7f-4123-ab77-b72f21dd95e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:32.790731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a59f2a6e-2f7f-4123-ab77-b72f21dd95e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:32.791989 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a59f2a6e-2f7f-4123-ab77-b72f21dd95e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:32.793118 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a59f2a6e-2f7f-4123-ab77-b72f21dd95e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:33.108195 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a59f2a6e-2f7f-4123-ab77-b72f21dd95e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:33.121674 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a59f2a6e-2f7f-4123-ab77-b72f21dd95e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.416641 Sep 06 16:18:33.123889 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 205/403] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:32 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:33.132298 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1997537f-7e29-47ef-9d6c-785c3aa29d22 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:33.133149 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1997537f-7e29-47ef-9d6c-785c3aa29d22 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:33.148098 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1997537f-7e29-47ef-9d6c-785c3aa29d22 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:33.149389 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1997537f-7e29-47ef-9d6c-785c3aa29d22 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:33.150904 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1997537f-7e29-47ef-9d6c-785c3aa29d22 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:33.155067 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1997537f-7e29-47ef-9d6c-785c3aa29d22 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:33.156114 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1997537f-7e29-47ef-9d6c-785c3aa29d22 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:33.157361 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1997537f-7e29-47ef-9d6c-785c3aa29d22 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:33.322319 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-10205afc-ca86-41ee-be40-55e43c082fe5 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:33.335458 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-10205afc-ca86-41ee-be40-55e43c082fe5 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1502 microversion: 2.1 time: 0.630553 Sep 06 16:18:33.336690 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 199/404] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:32 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1502 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:33.373315 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1997537f-7e29-47ef-9d6c-785c3aa29d22 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:33.388733 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1997537f-7e29-47ef-9d6c-785c3aa29d22 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.262883 Sep 06 16:18:33.409937 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 206/405] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:33 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:33.596287 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-cb9990a6-05c3-45dd-8024-18bd2c0de746 req-7fb3c223-eea5-459e-ad2b-277dd46afe1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3078c7e6-28cd-4a26-ba9e-5920ccc1f46a", "tag": "c0116dca-9ccf-4f2c-b879-4db2cc4f54a3"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:33.609684 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-cb9990a6-05c3-45dd-8024-18bd2c0de746 req-7fb3c223-eea5-459e-ad2b-277dd46afe1a service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:33.610150 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-cb9990a6-05c3-45dd-8024-18bd2c0de746 req-7fb3c223-eea5-459e-ad2b-277dd46afe1a service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:33.610593 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-cb9990a6-05c3-45dd-8024-18bd2c0de746 req-7fb3c223-eea5-459e-ad2b-277dd46afe1a service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:33.627346 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-cb9990a6-05c3-45dd-8024-18bd2c0de746 req-7fb3c223-eea5-459e-ad2b-277dd46afe1a service nova] Creating event network-changed:c0116dca-9ccf-4f2c-b879-4db2cc4f54a3 for instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a on hv-cinder-85221 Sep 06 16:18:33.633108 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-cb9990a6-05c3-45dd-8024-18bd2c0de746 req-7fb3c223-eea5-459e-ad2b-277dd46afe1a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040490 Sep 06 16:18:33.633737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 200/406] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:34.152522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2239ee34-5e40-4416-bd09-437816a43b6b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:34.153822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2239ee34-5e40-4416-bd09-437816a43b6b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:34.176187 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2239ee34-5e40-4416-bd09-437816a43b6b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:34.180340 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2239ee34-5e40-4416-bd09-437816a43b6b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:34.181213 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2239ee34-5e40-4416-bd09-437816a43b6b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:34.191045 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2239ee34-5e40-4416-bd09-437816a43b6b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:34.192049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2239ee34-5e40-4416-bd09-437816a43b6b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:34.192700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2239ee34-5e40-4416-bd09-437816a43b6b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:34.373659 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0997fef6-f93e-4e46-b325-21a143d855a8 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:34.374359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0997fef6-f93e-4e46-b325-21a143d855a8 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:34.383099 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0997fef6-f93e-4e46-b325-21a143d855a8 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:34.383590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0997fef6-f93e-4e46-b325-21a143d855a8 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:34.384283 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0997fef6-f93e-4e46-b325-21a143d855a8 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:34.384962 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0997fef6-f93e-4e46-b325-21a143d855a8 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:34.385574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0997fef6-f93e-4e46-b325-21a143d855a8 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:34.386152 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0997fef6-f93e-4e46-b325-21a143d855a8 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:34.489641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2239ee34-5e40-4416-bd09-437816a43b6b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:34.506653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2239ee34-5e40-4416-bd09-437816a43b6b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.360798 Sep 06 16:18:34.514356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 207/407] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:34 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:34.528308 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c399c8a3-c4ee-412a-96d7-18453df29516 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:34.534813 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c399c8a3-c4ee-412a-96d7-18453df29516 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:34.554860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c399c8a3-c4ee-412a-96d7-18453df29516 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:34.556948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c399c8a3-c4ee-412a-96d7-18453df29516 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:34.557843 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c399c8a3-c4ee-412a-96d7-18453df29516 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:34.562847 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c399c8a3-c4ee-412a-96d7-18453df29516 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:34.563687 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c399c8a3-c4ee-412a-96d7-18453df29516 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:34.565290 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c399c8a3-c4ee-412a-96d7-18453df29516 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:34.672620 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0997fef6-f93e-4e46-b325-21a143d855a8 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:34.688282 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0997fef6-f93e-4e46-b325-21a143d855a8 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1502 microversion: 2.1 time: 0.316485 Sep 06 16:18:34.689632 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 201/408] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:34 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1502 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:34.856711 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c399c8a3-c4ee-412a-96d7-18453df29516 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:34.868148 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c399c8a3-c4ee-412a-96d7-18453df29516 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.352066 Sep 06 16:18:34.869014 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 208/409] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:34 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:35.572792 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6940d4bd-ad36-4a72-bd45-fdfebd82948c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:35.572792 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6940d4bd-ad36-4a72-bd45-fdfebd82948c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:35.572792 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6940d4bd-ad36-4a72-bd45-fdfebd82948c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:35.573558 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6940d4bd-ad36-4a72-bd45-fdfebd82948c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:35.574252 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6940d4bd-ad36-4a72-bd45-fdfebd82948c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:35.581831 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6940d4bd-ad36-4a72-bd45-fdfebd82948c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:35.581831 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6940d4bd-ad36-4a72-bd45-fdfebd82948c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:35.581831 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6940d4bd-ad36-4a72-bd45-fdfebd82948c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:35.718118 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e541cd25-a076-4221-baf8-97e515aab576 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:35.718861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e541cd25-a076-4221-baf8-97e515aab576 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:35.727807 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e541cd25-a076-4221-baf8-97e515aab576 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:35.728708 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e541cd25-a076-4221-baf8-97e515aab576 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:35.729331 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e541cd25-a076-4221-baf8-97e515aab576 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:35.730296 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e541cd25-a076-4221-baf8-97e515aab576 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:35.730967 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e541cd25-a076-4221-baf8-97e515aab576 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:35.732350 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e541cd25-a076-4221-baf8-97e515aab576 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:35.959267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e541cd25-a076-4221-baf8-97e515aab576 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:35.972213 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e541cd25-a076-4221-baf8-97e515aab576 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1502 microversion: 2.1 time: 0.258159 Sep 06 16:18:35.981301 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6940d4bd-ad36-4a72-bd45-fdfebd82948c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:35.991603 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 209/410] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:35 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:36.000087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7be2daa3-f423-4d68-b6fd-29766d3e3533 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:36.002318 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6940d4bd-ad36-4a72-bd45-fdfebd82948c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.450388 Sep 06 16:18:36.009092 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 202/411] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:35 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:36.011811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7be2daa3-f423-4d68-b6fd-29766d3e3533 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:36.034735 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7be2daa3-f423-4d68-b6fd-29766d3e3533 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:36.037886 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7be2daa3-f423-4d68-b6fd-29766d3e3533 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:36.040892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7be2daa3-f423-4d68-b6fd-29766d3e3533 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:36.041917 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7be2daa3-f423-4d68-b6fd-29766d3e3533 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:36.042516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7be2daa3-f423-4d68-b6fd-29766d3e3533 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:36.044083 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7be2daa3-f423-4d68-b6fd-29766d3e3533 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:36.306238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7be2daa3-f423-4d68-b6fd-29766d3e3533 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:36.317875 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7be2daa3-f423-4d68-b6fd-29766d3e3533 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.324303 Sep 06 16:18:36.319870 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 210/412] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:35 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:37.015521 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e7610d8f-f775-4035-8482-2d3a25c286f2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:37.016137 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e7610d8f-f775-4035-8482-2d3a25c286f2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:37.023203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7610d8f-f775-4035-8482-2d3a25c286f2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:37.023791 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7610d8f-f775-4035-8482-2d3a25c286f2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:37.024114 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7610d8f-f775-4035-8482-2d3a25c286f2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:37.026311 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7610d8f-f775-4035-8482-2d3a25c286f2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:37.026311 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7610d8f-f775-4035-8482-2d3a25c286f2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:37.026311 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7610d8f-f775-4035-8482-2d3a25c286f2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:37.036206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-cd885c7d-7373-4c7b-bff8-8d17482dc593 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:37.037527 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-cd885c7d-7373-4c7b-bff8-8d17482dc593 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:37.046531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cd885c7d-7373-4c7b-bff8-8d17482dc593 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:37.047969 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cd885c7d-7373-4c7b-bff8-8d17482dc593 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:37.048449 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cd885c7d-7373-4c7b-bff8-8d17482dc593 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:37.049444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cd885c7d-7373-4c7b-bff8-8d17482dc593 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:37.050068 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cd885c7d-7373-4c7b-bff8-8d17482dc593 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:37.050838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cd885c7d-7373-4c7b-bff8-8d17482dc593 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:37.264829 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e7610d8f-f775-4035-8482-2d3a25c286f2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:37.286349 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cd885c7d-7373-4c7b-bff8-8d17482dc593 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:37.301017 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-cd885c7d-7373-4c7b-bff8-8d17482dc593 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.272294 Sep 06 16:18:37.302692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 211/413] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:37 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:37.307120 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e7610d8f-f775-4035-8482-2d3a25c286f2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1502 microversion: 2.1 time: 0.295551 Sep 06 16:18:37.308262 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 203/414] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:37 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1502 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:37.347884 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d1d10d0d-0724-45a3-9a69-3e7046ba39e6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:37.349372 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d1d10d0d-0724-45a3-9a69-3e7046ba39e6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:37.362271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1d10d0d-0724-45a3-9a69-3e7046ba39e6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:37.362780 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1d10d0d-0724-45a3-9a69-3e7046ba39e6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:37.363455 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1d10d0d-0724-45a3-9a69-3e7046ba39e6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:37.364386 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1d10d0d-0724-45a3-9a69-3e7046ba39e6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:37.365070 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1d10d0d-0724-45a3-9a69-3e7046ba39e6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:37.365660 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1d10d0d-0724-45a3-9a69-3e7046ba39e6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:37.626893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d1d10d0d-0724-45a3-9a69-3e7046ba39e6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:37.636780 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d1d10d0d-0724-45a3-9a69-3e7046ba39e6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.293586 Sep 06 16:18:37.638227 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 212/415] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:37 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:38.329139 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ad904e69-d4bd-40a4-b2ba-f9a29384e789 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:38.330641 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ad904e69-d4bd-40a4-b2ba-f9a29384e789 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:38.335725 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0b1a6eb5-eb8c-4efd-984f-872187993b77 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:38.337127 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0b1a6eb5-eb8c-4efd-984f-872187993b77 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:38.337840 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ad904e69-d4bd-40a4-b2ba-f9a29384e789 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:38.338526 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ad904e69-d4bd-40a4-b2ba-f9a29384e789 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:38.339154 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ad904e69-d4bd-40a4-b2ba-f9a29384e789 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:38.339848 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ad904e69-d4bd-40a4-b2ba-f9a29384e789 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:38.340298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ad904e69-d4bd-40a4-b2ba-f9a29384e789 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:38.340717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ad904e69-d4bd-40a4-b2ba-f9a29384e789 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:38.347674 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b1a6eb5-eb8c-4efd-984f-872187993b77 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:38.349288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b1a6eb5-eb8c-4efd-984f-872187993b77 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:38.350163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b1a6eb5-eb8c-4efd-984f-872187993b77 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:38.351712 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b1a6eb5-eb8c-4efd-984f-872187993b77 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:38.352356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b1a6eb5-eb8c-4efd-984f-872187993b77 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:38.353641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b1a6eb5-eb8c-4efd-984f-872187993b77 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:38.606771 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ad904e69-d4bd-40a4-b2ba-f9a29384e789 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:38.617051 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ad904e69-d4bd-40a4-b2ba-f9a29384e789 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.292382 Sep 06 16:18:38.617650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 204/416] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:38 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:38.665731 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d07cb56e-7a7c-410c-a042-f5e2e2392a8f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:38.666635 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d07cb56e-7a7c-410c-a042-f5e2e2392a8f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:38.687432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d07cb56e-7a7c-410c-a042-f5e2e2392a8f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:38.687938 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d07cb56e-7a7c-410c-a042-f5e2e2392a8f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:38.688635 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d07cb56e-7a7c-410c-a042-f5e2e2392a8f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:38.689116 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0b1a6eb5-eb8c-4efd-984f-872187993b77 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:38.689868 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d07cb56e-7a7c-410c-a042-f5e2e2392a8f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:38.690951 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d07cb56e-7a7c-410c-a042-f5e2e2392a8f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:38.691713 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d07cb56e-7a7c-410c-a042-f5e2e2392a8f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:38.698857 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0b1a6eb5-eb8c-4efd-984f-872187993b77 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1502 microversion: 2.1 time: 0.369638 Sep 06 16:18:38.699639 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 213/417] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:38 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1502 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:38.863119 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d07cb56e-7a7c-410c-a042-f5e2e2392a8f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:38.871470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d07cb56e-7a7c-410c-a042-f5e2e2392a8f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.211316 Sep 06 16:18:38.881320 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 205/418] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:38 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:39.643983 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4d18ba7d-1114-4f7c-9ec0-2930bd9144a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:39.644830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4d18ba7d-1114-4f7c-9ec0-2930bd9144a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:39.652207 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d18ba7d-1114-4f7c-9ec0-2930bd9144a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:39.653023 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d18ba7d-1114-4f7c-9ec0-2930bd9144a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:39.653819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d18ba7d-1114-4f7c-9ec0-2930bd9144a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:39.654664 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d18ba7d-1114-4f7c-9ec0-2930bd9144a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:39.655170 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d18ba7d-1114-4f7c-9ec0-2930bd9144a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:39.655592 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d18ba7d-1114-4f7c-9ec0-2930bd9144a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:39.731045 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d1235f36-27bb-4388-89d4-47228dec7458 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:39.734090 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d1235f36-27bb-4388-89d4-47228dec7458 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:39.747353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d1235f36-27bb-4388-89d4-47228dec7458 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:39.749065 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d1235f36-27bb-4388-89d4-47228dec7458 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:39.749757 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d1235f36-27bb-4388-89d4-47228dec7458 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:39.752071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d1235f36-27bb-4388-89d4-47228dec7458 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:39.752803 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d1235f36-27bb-4388-89d4-47228dec7458 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:39.753427 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d1235f36-27bb-4388-89d4-47228dec7458 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:39.875211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4d18ba7d-1114-4f7c-9ec0-2930bd9144a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:39.886436 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4d18ba7d-1114-4f7c-9ec0-2930bd9144a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.246605 Sep 06 16:18:39.906142 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 214/419] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:39 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:39.937739 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-bd7686f3-bb8a-4fb2-ac5e-eec00b82870e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:39.939590 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-bd7686f3-bb8a-4fb2-ac5e-eec00b82870e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:39.951855 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd7686f3-bb8a-4fb2-ac5e-eec00b82870e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:39.953531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd7686f3-bb8a-4fb2-ac5e-eec00b82870e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:39.954614 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd7686f3-bb8a-4fb2-ac5e-eec00b82870e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:39.956200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd7686f3-bb8a-4fb2-ac5e-eec00b82870e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:39.957252 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd7686f3-bb8a-4fb2-ac5e-eec00b82870e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:39.958622 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd7686f3-bb8a-4fb2-ac5e-eec00b82870e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:39.999399 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d1235f36-27bb-4388-89d4-47228dec7458 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:40.008222 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d1235f36-27bb-4388-89d4-47228dec7458 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1502 microversion: 2.1 time: 0.285457 Sep 06 16:18:40.009540 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 206/420] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:39 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1502 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:40.178554 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-bd7686f3-bb8a-4fb2-ac5e-eec00b82870e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:40.186825 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-bd7686f3-bb8a-4fb2-ac5e-eec00b82870e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.278203 Sep 06 16:18:40.187429 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 215/421] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:39 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:40.940863 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-80ab2daa-2513-45a9-a539-a590dd2df518 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:40.941585 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-80ab2daa-2513-45a9-a539-a590dd2df518 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:40.948818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80ab2daa-2513-45a9-a539-a590dd2df518 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:40.949274 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80ab2daa-2513-45a9-a539-a590dd2df518 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:40.950112 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80ab2daa-2513-45a9-a539-a590dd2df518 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:40.950884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80ab2daa-2513-45a9-a539-a590dd2df518 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:40.951349 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80ab2daa-2513-45a9-a539-a590dd2df518 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:40.951788 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80ab2daa-2513-45a9-a539-a590dd2df518 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:41.032096 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c98b74a1-5535-4097-b178-6e15b0de7f91 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:41.032807 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c98b74a1-5535-4097-b178-6e15b0de7f91 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:41.038951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c98b74a1-5535-4097-b178-6e15b0de7f91 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:41.039444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c98b74a1-5535-4097-b178-6e15b0de7f91 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:41.039876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c98b74a1-5535-4097-b178-6e15b0de7f91 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:41.040577 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c98b74a1-5535-4097-b178-6e15b0de7f91 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:41.041049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c98b74a1-5535-4097-b178-6e15b0de7f91 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:41.041472 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c98b74a1-5535-4097-b178-6e15b0de7f91 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:41.176289 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-80ab2daa-2513-45a9-a539-a590dd2df518 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:41.186330 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-80ab2daa-2513-45a9-a539-a590dd2df518 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.250460 Sep 06 16:18:41.187646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 207/422] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:40 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:41.212134 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6b5ff038-f27f-4cc0-98f6-962fc1e37d29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:41.213201 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6b5ff038-f27f-4cc0-98f6-962fc1e37d29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:41.222204 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b5ff038-f27f-4cc0-98f6-962fc1e37d29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:41.223737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b5ff038-f27f-4cc0-98f6-962fc1e37d29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:41.224408 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b5ff038-f27f-4cc0-98f6-962fc1e37d29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:41.226231 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b5ff038-f27f-4cc0-98f6-962fc1e37d29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:41.226951 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b5ff038-f27f-4cc0-98f6-962fc1e37d29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:41.228214 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b5ff038-f27f-4cc0-98f6-962fc1e37d29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:41.235280 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c98b74a1-5535-4097-b178-6e15b0de7f91 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:41.244921 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c98b74a1-5535-4097-b178-6e15b0de7f91 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1502 microversion: 2.1 time: 0.217055 Sep 06 16:18:41.262139 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 216/423] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:41 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:41.448179 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6b5ff038-f27f-4cc0-98f6-962fc1e37d29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:41.457529 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6b5ff038-f27f-4cc0-98f6-962fc1e37d29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.249993 Sep 06 16:18:41.468362 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 208/424] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:41 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:42.210099 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c7be72d8-040d-4571-906e-c7fbd3f2b7b2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:42.210767 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c7be72d8-040d-4571-906e-c7fbd3f2b7b2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:42.217164 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c7be72d8-040d-4571-906e-c7fbd3f2b7b2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:42.217638 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c7be72d8-040d-4571-906e-c7fbd3f2b7b2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:42.218061 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c7be72d8-040d-4571-906e-c7fbd3f2b7b2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:42.218741 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c7be72d8-040d-4571-906e-c7fbd3f2b7b2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:42.219185 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c7be72d8-040d-4571-906e-c7fbd3f2b7b2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:42.219595 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c7be72d8-040d-4571-906e-c7fbd3f2b7b2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:42.271393 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b363bde9-7845-48ef-a7e0-1eb97d60d3fd tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:42.280595 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b363bde9-7845-48ef-a7e0-1eb97d60d3fd tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:42.288808 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b363bde9-7845-48ef-a7e0-1eb97d60d3fd tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:42.289292 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b363bde9-7845-48ef-a7e0-1eb97d60d3fd tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:42.289946 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b363bde9-7845-48ef-a7e0-1eb97d60d3fd tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:42.290649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b363bde9-7845-48ef-a7e0-1eb97d60d3fd tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:42.291316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b363bde9-7845-48ef-a7e0-1eb97d60d3fd tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:42.291757 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b363bde9-7845-48ef-a7e0-1eb97d60d3fd tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:42.445937 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c7be72d8-040d-4571-906e-c7fbd3f2b7b2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:42.454247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b363bde9-7845-48ef-a7e0-1eb97d60d3fd tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:42.456416 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c7be72d8-040d-4571-906e-c7fbd3f2b7b2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.250099 Sep 06 16:18:42.457066 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 217/425] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:42 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:42.475870 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b363bde9-7845-48ef-a7e0-1eb97d60d3fd tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1502 microversion: 2.1 time: 0.209069 Sep 06 16:18:42.477409 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 209/426] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:42 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:42.498242 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-39e71cc3-cf6e-4932-96f5-0163877ec47a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:42.498993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-39e71cc3-cf6e-4932-96f5-0163877ec47a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:42.505483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39e71cc3-cf6e-4932-96f5-0163877ec47a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:42.505970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39e71cc3-cf6e-4932-96f5-0163877ec47a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:42.506516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39e71cc3-cf6e-4932-96f5-0163877ec47a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:42.507485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39e71cc3-cf6e-4932-96f5-0163877ec47a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:42.507854 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39e71cc3-cf6e-4932-96f5-0163877ec47a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:42.508270 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-39e71cc3-cf6e-4932-96f5-0163877ec47a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:42.694442 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-39e71cc3-cf6e-4932-96f5-0163877ec47a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:42.705951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-39e71cc3-cf6e-4932-96f5-0163877ec47a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.211464 Sep 06 16:18:42.707033 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 218/427] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:42 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:43.479539 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4f1e5f80-cd3b-4a36-b3e2-9d919aeb8164 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:43.480312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4f1e5f80-cd3b-4a36-b3e2-9d919aeb8164 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:43.487400 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f1e5f80-cd3b-4a36-b3e2-9d919aeb8164 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:43.487877 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f1e5f80-cd3b-4a36-b3e2-9d919aeb8164 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:43.488306 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f1e5f80-cd3b-4a36-b3e2-9d919aeb8164 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:43.489019 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f1e5f80-cd3b-4a36-b3e2-9d919aeb8164 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:43.489465 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f1e5f80-cd3b-4a36-b3e2-9d919aeb8164 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:43.495156 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f1e5f80-cd3b-4a36-b3e2-9d919aeb8164 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:43.510478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-26c9f4d9-9d03-4e5c-93ef-46aab166b0db tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:43.511328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-26c9f4d9-9d03-4e5c-93ef-46aab166b0db tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:43.518227 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-26c9f4d9-9d03-4e5c-93ef-46aab166b0db tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:43.518697 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-26c9f4d9-9d03-4e5c-93ef-46aab166b0db tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:43.519788 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-26c9f4d9-9d03-4e5c-93ef-46aab166b0db tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:43.520008 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-26c9f4d9-9d03-4e5c-93ef-46aab166b0db tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:43.520457 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-26c9f4d9-9d03-4e5c-93ef-46aab166b0db tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:43.520926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-26c9f4d9-9d03-4e5c-93ef-46aab166b0db tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:43.634884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4f1e5f80-cd3b-4a36-b3e2-9d919aeb8164 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:43.646922 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4f1e5f80-cd3b-4a36-b3e2-9d919aeb8164 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.167754 Sep 06 16:18:43.650203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 210/428] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:43 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:43.708368 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-26c9f4d9-9d03-4e5c-93ef-46aab166b0db tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:43.717008 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-26c9f4d9-9d03-4e5c-93ef-46aab166b0db tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1502 microversion: 2.1 time: 0.210348 Sep 06 16:18:43.717605 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 219/429] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:43 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:43.733975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-064b2e63-4d52-45ea-b566-fa3342867d39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:43.734677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-064b2e63-4d52-45ea-b566-fa3342867d39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:43.741409 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-064b2e63-4d52-45ea-b566-fa3342867d39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:43.741896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-064b2e63-4d52-45ea-b566-fa3342867d39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:43.742327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-064b2e63-4d52-45ea-b566-fa3342867d39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:43.743040 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-064b2e63-4d52-45ea-b566-fa3342867d39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:43.743837 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-064b2e63-4d52-45ea-b566-fa3342867d39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:43.744265 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-064b2e63-4d52-45ea-b566-fa3342867d39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:43.927281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-064b2e63-4d52-45ea-b566-fa3342867d39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:43.937429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-064b2e63-4d52-45ea-b566-fa3342867d39 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.207791 Sep 06 16:18:43.938084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 211/430] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:43 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:44.666300 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c33c0511-f015-4ab4-969b-62ec1bfb05c0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:44.666999 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c33c0511-f015-4ab4-969b-62ec1bfb05c0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:44.673165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c33c0511-f015-4ab4-969b-62ec1bfb05c0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:44.673911 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c33c0511-f015-4ab4-969b-62ec1bfb05c0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:44.674236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c33c0511-f015-4ab4-969b-62ec1bfb05c0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:44.674977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c33c0511-f015-4ab4-969b-62ec1bfb05c0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:44.675438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c33c0511-f015-4ab4-969b-62ec1bfb05c0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:44.675849 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c33c0511-f015-4ab4-969b-62ec1bfb05c0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:44.742645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-733a30c3-ed01-4e0f-b372-9b76b6289596 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:44.746557 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-733a30c3-ed01-4e0f-b372-9b76b6289596 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:44.750385 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-733a30c3-ed01-4e0f-b372-9b76b6289596 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:44.750816 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-733a30c3-ed01-4e0f-b372-9b76b6289596 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:44.751352 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-733a30c3-ed01-4e0f-b372-9b76b6289596 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:44.752071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-733a30c3-ed01-4e0f-b372-9b76b6289596 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:44.752521 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-733a30c3-ed01-4e0f-b372-9b76b6289596 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:44.753153 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-733a30c3-ed01-4e0f-b372-9b76b6289596 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:44.821462 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c33c0511-f015-4ab4-969b-62ec1bfb05c0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:44.834300 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c33c0511-f015-4ab4-969b-62ec1bfb05c0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.171837 Sep 06 16:18:44.835064 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 220/431] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:44 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:44.903298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-733a30c3-ed01-4e0f-b372-9b76b6289596 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:44.912908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-733a30c3-ed01-4e0f-b372-9b76b6289596 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1502 microversion: 2.1 time: 0.174522 Sep 06 16:18:44.913527 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 212/432] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:44 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:44.962801 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-acaca65f-cc91-4035-8cfd-7d4f195904a6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:44.963819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-acaca65f-cc91-4035-8cfd-7d4f195904a6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:44.970654 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-acaca65f-cc91-4035-8cfd-7d4f195904a6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:44.971128 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-acaca65f-cc91-4035-8cfd-7d4f195904a6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:44.971552 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-acaca65f-cc91-4035-8cfd-7d4f195904a6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:44.972235 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-acaca65f-cc91-4035-8cfd-7d4f195904a6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:44.972903 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-acaca65f-cc91-4035-8cfd-7d4f195904a6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:44.973204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-acaca65f-cc91-4035-8cfd-7d4f195904a6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:44.977574 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:45.118699 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-acaca65f-cc91-4035-8cfd-7d4f195904a6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:45.128779 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-acaca65f-cc91-4035-8cfd-7d4f195904a6 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.170753 Sep 06 16:18:45.129394 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 221/433] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:44 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:45.860035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-eedf30c0-1546-4d6f-9613-ead43b469ec0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:45.860651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-eedf30c0-1546-4d6f-9613-ead43b469ec0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:45.867975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eedf30c0-1546-4d6f-9613-ead43b469ec0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:45.868796 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eedf30c0-1546-4d6f-9613-ead43b469ec0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:45.869578 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eedf30c0-1546-4d6f-9613-ead43b469ec0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:45.870144 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eedf30c0-1546-4d6f-9613-ead43b469ec0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:45.870677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eedf30c0-1546-4d6f-9613-ead43b469ec0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:45.871747 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eedf30c0-1546-4d6f-9613-ead43b469ec0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:45.937285 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a7e265f0-13f4-4dea-a390-96c76df127f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:45.938516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a7e265f0-13f4-4dea-a390-96c76df127f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:45.945002 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7e265f0-13f4-4dea-a390-96c76df127f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:45.945818 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7e265f0-13f4-4dea-a390-96c76df127f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:45.946310 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7e265f0-13f4-4dea-a390-96c76df127f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:45.947075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7e265f0-13f4-4dea-a390-96c76df127f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:45.947670 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7e265f0-13f4-4dea-a390-96c76df127f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:45.948176 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7e265f0-13f4-4dea-a390-96c76df127f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:46.147779 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-eedf30c0-1546-4d6f-9613-ead43b469ec0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:46.149496 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a7e265f0-13f4-4dea-a390-96c76df127f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:46.159818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-eedf30c0-1546-4d6f-9613-ead43b469ec0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.305194 Sep 06 16:18:46.160956 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a7e265f0-13f4-4dea-a390-96c76df127f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1502 microversion: 2.1 time: 0.228377 Sep 06 16:18:46.161804 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 222/434] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:45 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:46.165550 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 213/435] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:45 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:46.181581 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0b149c86-ee90-4bfd-a25d-430932801e9a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:46.182235 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0b149c86-ee90-4bfd-a25d-430932801e9a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:46.189663 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b149c86-ee90-4bfd-a25d-430932801e9a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:46.190401 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b149c86-ee90-4bfd-a25d-430932801e9a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:46.191133 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b149c86-ee90-4bfd-a25d-430932801e9a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:46.191834 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b149c86-ee90-4bfd-a25d-430932801e9a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:46.192287 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b149c86-ee90-4bfd-a25d-430932801e9a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:46.192699 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0b149c86-ee90-4bfd-a25d-430932801e9a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:46.339861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0b149c86-ee90-4bfd-a25d-430932801e9a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:46.350821 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0b149c86-ee90-4bfd-a25d-430932801e9a tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.187394 Sep 06 16:18:46.351707 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 223/436] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:46 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:46.627691 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-fb61cbf6-52c5-451b-9afd-2105197731f0 req-83d2d6cf-e050-4935-9a5d-bb21697acd9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449e6106-faac-4d42-b021-674742c4d201", "name": "network-vif-deleted", "tag": "d19f49a2-3073-4f0d-88df-4536fe68481f"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:46.647354 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-fb61cbf6-52c5-451b-9afd-2105197731f0 req-83d2d6cf-e050-4935-9a5d-bb21697acd9b service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:46.647906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-fb61cbf6-52c5-451b-9afd-2105197731f0 req-83d2d6cf-e050-4935-9a5d-bb21697acd9b service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:46.650685 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-fb61cbf6-52c5-451b-9afd-2105197731f0 req-83d2d6cf-e050-4935-9a5d-bb21697acd9b service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:46.664378 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-fb61cbf6-52c5-451b-9afd-2105197731f0 req-83d2d6cf-e050-4935-9a5d-bb21697acd9b service nova] Creating event network-vif-deleted:d19f49a2-3073-4f0d-88df-4536fe68481f for instance 449e6106-faac-4d42-b021-674742c4d201 on hv-cinder-85221 Sep 06 16:18:46.670021 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-fb61cbf6-52c5-451b-9afd-2105197731f0 req-83d2d6cf-e050-4935-9a5d-bb21697acd9b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046694 Sep 06 16:18:46.671026 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 214/437] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:47.194143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:47.194810 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:47.196724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:47.197813 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-351a4f2b-70f7-4989-88f1-0badaca17a3f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:47.198663 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-351a4f2b-70f7-4989-88f1-0badaca17a3f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:47.209958 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:47.210556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:47.210990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:47.211684 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:47.212130 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:47.212547 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:47.217907 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-351a4f2b-70f7-4989-88f1-0badaca17a3f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:47.218378 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-351a4f2b-70f7-4989-88f1-0badaca17a3f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:47.218837 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-351a4f2b-70f7-4989-88f1-0badaca17a3f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:47.219550 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-351a4f2b-70f7-4989-88f1-0badaca17a3f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:47.220045 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-351a4f2b-70f7-4989-88f1-0badaca17a3f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:47.220791 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-351a4f2b-70f7-4989-88f1-0badaca17a3f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:47.241079 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:47.247936 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:47.248611 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:47.249158 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:47.252196 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lazy-loading 'fault' on Instance uuid 449e6106-faac-4d42-b021-674742c4d201 {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:18:47.309893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:47.321110 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-34913ea2-c420-4178-abff-d7dfe8935f07 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1303 microversion: 2.1 time: 0.128484 Sep 06 16:18:47.321910 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 224/438] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:47 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:47.374807 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-351a4f2b-70f7-4989-88f1-0badaca17a3f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:47.376899 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7dffec2b-932a-45c7-88d6-d1a22076a96f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:47.377523 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7dffec2b-932a-45c7-88d6-d1a22076a96f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:47.385350 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7dffec2b-932a-45c7-88d6-d1a22076a96f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:47.385591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-351a4f2b-70f7-4989-88f1-0badaca17a3f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.200822 Sep 06 16:18:47.385864 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7dffec2b-932a-45c7-88d6-d1a22076a96f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:47.386211 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 215/439] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:47 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:47.386355 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7dffec2b-932a-45c7-88d6-d1a22076a96f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:47.387008 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7dffec2b-932a-45c7-88d6-d1a22076a96f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:47.387445 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7dffec2b-932a-45c7-88d6-d1a22076a96f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:47.387887 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7dffec2b-932a-45c7-88d6-d1a22076a96f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:47.555359 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7dffec2b-932a-45c7-88d6-d1a22076a96f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:47.563753 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7dffec2b-932a-45c7-88d6-d1a22076a96f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.192546 Sep 06 16:18:47.564413 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 225/440] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:47 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:48.345966 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:48.346694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:48.353965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:48.354548 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:48.355075 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:48.355800 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:48.356236 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:48.356681 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:48.389702 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:48.390198 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:48.390618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:48.391042 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lazy-loading 'fault' on Instance uuid 449e6106-faac-4d42-b021-674742c4d201 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:18:48.415282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a4e8fc0c-7d19-4ef1-a0b9-cec48b98d378 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:48.416115 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a4e8fc0c-7d19-4ef1-a0b9-cec48b98d378 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:48.422932 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4e8fc0c-7d19-4ef1-a0b9-cec48b98d378 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:48.423647 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4e8fc0c-7d19-4ef1-a0b9-cec48b98d378 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:48.424289 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4e8fc0c-7d19-4ef1-a0b9-cec48b98d378 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:48.425103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4e8fc0c-7d19-4ef1-a0b9-cec48b98d378 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:48.425686 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4e8fc0c-7d19-4ef1-a0b9-cec48b98d378 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:48.426168 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4e8fc0c-7d19-4ef1-a0b9-cec48b98d378 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:48.437650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:48.445823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6cf96093-bbd7-4588-a8e8-4bfc3f71cff0 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1303 microversion: 2.1 time: 0.103769 Sep 06 16:18:48.446432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 216/441] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:48 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:48.572881 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a4e8fc0c-7d19-4ef1-a0b9-cec48b98d378 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:48.582623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a4e8fc0c-7d19-4ef1-a0b9-cec48b98d378 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.171997 Sep 06 16:18:48.583251 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 226/442] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:48 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:48.592367 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b61a49c3-c039-4738-9d0b-13fabb059331 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:48.593272 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b61a49c3-c039-4738-9d0b-13fabb059331 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:48.600478 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b61a49c3-c039-4738-9d0b-13fabb059331 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:48.601037 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b61a49c3-c039-4738-9d0b-13fabb059331 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:48.601606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b61a49c3-c039-4738-9d0b-13fabb059331 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:48.602575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b61a49c3-c039-4738-9d0b-13fabb059331 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:48.603068 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b61a49c3-c039-4738-9d0b-13fabb059331 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:48.603553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b61a49c3-c039-4738-9d0b-13fabb059331 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:48.751979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b61a49c3-c039-4738-9d0b-13fabb059331 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:48.761018 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b61a49c3-c039-4738-9d0b-13fabb059331 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.174521 Sep 06 16:18:48.761628 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 217/443] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:48 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:49.469085 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:49.469691 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:49.476224 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:49.476716 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:49.477167 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:49.477908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:49.478346 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:49.478788 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:49.510385 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:49.510868 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:49.511597 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:49.512108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lazy-loading 'fault' on Instance uuid 449e6106-faac-4d42-b021-674742c4d201 {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:18:49.563829 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:49.574885 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-77d9d4f3-7761-485e-a536-c821515b4567 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 200 len: 1303 microversion: 2.1 time: 0.109412 Sep 06 16:18:49.575768 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 227/444] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:49 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:49.610593 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4a3ca182-62d8-4039-a1c1-308e45f00650 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:49.611871 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4a3ca182-62d8-4039-a1c1-308e45f00650 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:49.621991 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4a3ca182-62d8-4039-a1c1-308e45f00650 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:49.622478 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4a3ca182-62d8-4039-a1c1-308e45f00650 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:49.622902 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4a3ca182-62d8-4039-a1c1-308e45f00650 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:49.623612 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4a3ca182-62d8-4039-a1c1-308e45f00650 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:49.624537 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4a3ca182-62d8-4039-a1c1-308e45f00650 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:49.624986 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4a3ca182-62d8-4039-a1c1-308e45f00650 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:49.787286 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1a5e37c5-d913-498f-bfd0-d9dee1c1bea1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:49.789164 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1a5e37c5-d913-498f-bfd0-d9dee1c1bea1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:49.796319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1a5e37c5-d913-498f-bfd0-d9dee1c1bea1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:49.797111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1a5e37c5-d913-498f-bfd0-d9dee1c1bea1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:49.797721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1a5e37c5-d913-498f-bfd0-d9dee1c1bea1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:49.798806 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1a5e37c5-d913-498f-bfd0-d9dee1c1bea1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:49.799686 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1a5e37c5-d913-498f-bfd0-d9dee1c1bea1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:49.800262 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1a5e37c5-d913-498f-bfd0-d9dee1c1bea1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:49.891745 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4a3ca182-62d8-4039-a1c1-308e45f00650 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:49.907513 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4a3ca182-62d8-4039-a1c1-308e45f00650 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.297809 Sep 06 16:18:49.908977 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 218/445] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:49 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:49.990466 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1a5e37c5-d913-498f-bfd0-d9dee1c1bea1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:49.999938 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1a5e37c5-d913-498f-bfd0-d9dee1c1bea1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.217576 Sep 06 16:18:50.017605 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 228/446] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:49 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:50.617663 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9a92ac75-9c6f-4806-aa08-8e643f72a8b4 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:50.617663 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9a92ac75-9c6f-4806-aa08-8e643f72a8b4 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: 449e6106-faac-4d42-b021-674742c4d201] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:50.631662 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a92ac75-9c6f-4806-aa08-8e643f72a8b4 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:50.633119 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a92ac75-9c6f-4806-aa08-8e643f72a8b4 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:50.633601 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a92ac75-9c6f-4806-aa08-8e643f72a8b4 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:50.634331 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a92ac75-9c6f-4806-aa08-8e643f72a8b4 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:50.636334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a92ac75-9c6f-4806-aa08-8e643f72a8b4 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:50.637980 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a92ac75-9c6f-4806-aa08-8e643f72a8b4 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:50.661933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-9a92ac75-9c6f-4806-aa08-8e643f72a8b4 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] HTTP exception thrown: Instance 449e6106-faac-4d42-b021-674742c4d201 could not be found. Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9a92ac75-9c6f-4806-aa08-8e643f72a8b4 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Request method failure captured: Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 HTTP/1.1 Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3KxNiM1HupUP7RsC4gq4C0LBnS5IDy-S1nhwceRoTNwg1vnleD6YjegryfDqedg8IPJ4ZOZoznaSEGu3y5WFjkRnpzzciihVCcZOn7PXeqclIwC_9sItKewokj3aGQjlOmI7t5MC45ygDGVkclEGN4bO7tC19X9npvuf07coG9Pwhs Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 4a2dcd76a5f24bd7ba164032cbe22d20 Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesActionsTest-961304812 Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:18:50.663860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:18:50.665218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a2dcd76a5f24bd7ba164032cbe22d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a2dcd76a5f24bd7ba164032cbe22d20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a2dcd76a5f24bd7ba164032cbe22d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a2dcd76a5f24bd7ba164032cbe22d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:18:50.665218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesActionsTest-961304812 Sep 06 16:18:50.665218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 4a2dcd76a5f24bd7ba164032cbe22d20 Sep 06 16:18:50.665218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesActionsTest-961304812 Sep 06 16:18:50.665218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesActionsTest-961304812-project Sep 06 16:18:50.665218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:18:50.665218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:18:50.665218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 2921386cc370487da26a786c8198c94c Sep 06 16:18:50.665218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesActionsTest-961304812-project Sep 06 16:18:50.665218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:18:50.665218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance 449e6106-faac-4d42-b021-674742c4d201 could not be found. Sep 06 16:18:50.665218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': '449e6106-faac-4d42-b021-674742c4d201'} Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449e6106-faac-4d42-b021-674742c4d201 could not be found. Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:18:50.665978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449e6106-faac-4d42-b021-674742c4d201 could not be found. Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449e6106-faac-4d42-b021-674742c4d201 could not be found. Sep 06 16:18:50.667161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:18:50.670622 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9a92ac75-9c6f-4806-aa08-8e643f72a8b4 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Returning 404 to user: Instance 449e6106-faac-4d42-b021-674742c4d201 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:18:50.672089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9a92ac75-9c6f-4806-aa08-8e643f72a8b4 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201" status: 404 len: 111 microversion: 2.1 time: 0.077752 Sep 06 16:18:50.673971 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 219/447] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:50 2022] GET /compute/v2.1/servers/449e6106-faac-4d42-b021-674742c4d201 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:18:50.828120 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1560235120", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "networks": [{"uuid": "e817f63d-ad34-42f8-aaac-1bf67dac54b6"}]}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:50.887643 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.network.neutron [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] validate_networks() for [('e817f63d-ad34-42f8-aaac-1bf67dac54b6', None, None, None, None, None)] {{(pid=120668) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:18:50.933314 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-43cbc3bd-2603-40eb-a828-14dac8982977 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:50.934132 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-43cbc3bd-2603-40eb-a828-14dac8982977 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:50.949256 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43cbc3bd-2603-40eb-a828-14dac8982977 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:50.949752 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43cbc3bd-2603-40eb-a828-14dac8982977 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:50.950181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43cbc3bd-2603-40eb-a828-14dac8982977 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:50.953977 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43cbc3bd-2603-40eb-a828-14dac8982977 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:50.954457 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43cbc3bd-2603-40eb-a828-14dac8982977 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:50.954928 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43cbc3bd-2603-40eb-a828-14dac8982977 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:51.125299 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-43cbc3bd-2603-40eb-a828-14dac8982977 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:51.144049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-43cbc3bd-2603-40eb-a828-14dac8982977 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.216808 Sep 06 16:18:51.144787 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 220/448] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:50 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:51.150352 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-987dac52-217b-4315-91e4-e298700a3247 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:51.151199 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-987dac52-217b-4315-91e4-e298700a3247 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:51.158918 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-987dac52-217b-4315-91e4-e298700a3247 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:51.159398 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-987dac52-217b-4315-91e4-e298700a3247 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:51.160084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-987dac52-217b-4315-91e4-e298700a3247 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:51.161505 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-987dac52-217b-4315-91e4-e298700a3247 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:51.161995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-987dac52-217b-4315-91e4-e298700a3247 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:51.162537 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-987dac52-217b-4315-91e4-e298700a3247 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:51.324851 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-987dac52-217b-4315-91e4-e298700a3247 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:51.339622 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-987dac52-217b-4315-91e4-e298700a3247 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.193057 Sep 06 16:18:51.353474 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 221/449] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:51 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:51.415281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Flavor limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:18:51.416701 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Image limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:18:51.417688 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Flavor pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:18:51.417972 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Image pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:18:51.418623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:18:51.437119 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:51.437654 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:51.438296 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:51.439232 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:51.439677 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:51.440266 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:51.476170 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Getting quotas for project 4a2dcd76a5f24bd7ba164032cbe22d20. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:18:51.480961 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Getting quotas for user 2921386cc370487da26a786c8198c94c and project 4a2dcd76a5f24bd7ba164032cbe22d20. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:18:51.494237 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Going to run 1 instances... {{(pid=120668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:18:51.497089 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:18:51.555978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c5e5c34e-4c95-4636-91fb-a91300c8ff79 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735355 Sep 06 16:18:51.557018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 229/450] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:18:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:18:51.575267 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-908d212c-ce9b-4405-8a8e-9824b1513cb9 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:51.575267 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-908d212c-ce9b-4405-8a8e-9824b1513cb9 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:51.660012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-908d212c-ce9b-4405-8a8e-9824b1513cb9 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:51.667394 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-908d212c-ce9b-4405-8a8e-9824b1513cb9 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1214 microversion: 2.1 time: 0.102101 Sep 06 16:18:51.668380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 222/451] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:51 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:52.168240 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a7d0bb80-73c1-4d8b-ad8b-e26ec0eee224 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:52.169001 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a7d0bb80-73c1-4d8b-ad8b-e26ec0eee224 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:52.179968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7d0bb80-73c1-4d8b-ad8b-e26ec0eee224 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:52.180730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7d0bb80-73c1-4d8b-ad8b-e26ec0eee224 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:52.181955 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7d0bb80-73c1-4d8b-ad8b-e26ec0eee224 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:52.182883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7d0bb80-73c1-4d8b-ad8b-e26ec0eee224 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:52.183516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7d0bb80-73c1-4d8b-ad8b-e26ec0eee224 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:52.184159 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7d0bb80-73c1-4d8b-ad8b-e26ec0eee224 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:52.370503 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-62fd16a8-6168-47d1-ae48-12a1484e3113 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:52.371203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-62fd16a8-6168-47d1-ae48-12a1484e3113 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:52.381290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-62fd16a8-6168-47d1-ae48-12a1484e3113 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:52.382058 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-62fd16a8-6168-47d1-ae48-12a1484e3113 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:52.382793 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-62fd16a8-6168-47d1-ae48-12a1484e3113 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:52.383882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-62fd16a8-6168-47d1-ae48-12a1484e3113 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:52.384579 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-62fd16a8-6168-47d1-ae48-12a1484e3113 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:52.385787 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-62fd16a8-6168-47d1-ae48-12a1484e3113 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:52.398234 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a7d0bb80-73c1-4d8b-ad8b-e26ec0eee224 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:52.407020 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a7d0bb80-73c1-4d8b-ad8b-e26ec0eee224 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.242624 Sep 06 16:18:52.407950 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 230/452] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:52 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:52.645031 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-62fd16a8-6168-47d1-ae48-12a1484e3113 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:52.656311 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-62fd16a8-6168-47d1-ae48-12a1484e3113 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.291461 Sep 06 16:18:52.656968 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 223/453] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:52 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:52.692729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b2911252-b3e1-4a07-8854-6f896bbb3a44 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:52.694152 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b2911252-b3e1-4a07-8854-6f896bbb3a44 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:52.704074 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2911252-b3e1-4a07-8854-6f896bbb3a44 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:52.704718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2911252-b3e1-4a07-8854-6f896bbb3a44 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:52.705352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2911252-b3e1-4a07-8854-6f896bbb3a44 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:52.706281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2911252-b3e1-4a07-8854-6f896bbb3a44 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:52.707148 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2911252-b3e1-4a07-8854-6f896bbb3a44 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:52.718144 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2911252-b3e1-4a07-8854-6f896bbb3a44 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:52.813445 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b2911252-b3e1-4a07-8854-6f896bbb3a44 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:52.822357 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b2911252-b3e1-4a07-8854-6f896bbb3a44 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1266 microversion: 2.1 time: 0.134053 Sep 06 16:18:52.822934 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 231/454] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:52 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:53.434451 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-04640600-785b-46f4-9832-95c205d9b187 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:53.435417 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-04640600-785b-46f4-9832-95c205d9b187 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:53.443921 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-04640600-785b-46f4-9832-95c205d9b187 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:53.444547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-04640600-785b-46f4-9832-95c205d9b187 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:53.445335 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-04640600-785b-46f4-9832-95c205d9b187 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:53.446363 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-04640600-785b-46f4-9832-95c205d9b187 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:53.447115 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-04640600-785b-46f4-9832-95c205d9b187 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:53.447776 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-04640600-785b-46f4-9832-95c205d9b187 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:53.572482 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-42dc9dcc-214a-4dcc-9143-6bc8bbf943fe req-3d192399-019b-46e7-82ae-b8bbec60a341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3078c7e6-28cd-4a26-ba9e-5920ccc1f46a", "name": "network-vif-plugged", "status": "completed", "tag": "c0116dca-9ccf-4f2c-b879-4db2cc4f54a3"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:53.583919 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-42dc9dcc-214a-4dcc-9143-6bc8bbf943fe req-3d192399-019b-46e7-82ae-b8bbec60a341 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:53.584685 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-42dc9dcc-214a-4dcc-9143-6bc8bbf943fe req-3d192399-019b-46e7-82ae-b8bbec60a341 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:53.585439 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-42dc9dcc-214a-4dcc-9143-6bc8bbf943fe req-3d192399-019b-46e7-82ae-b8bbec60a341 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:53.597684 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-42dc9dcc-214a-4dcc-9143-6bc8bbf943fe req-3d192399-019b-46e7-82ae-b8bbec60a341 service nova] Creating event network-vif-plugged:c0116dca-9ccf-4f2c-b879-4db2cc4f54a3 for instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a on hv-cinder-85221 Sep 06 16:18:53.603356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-42dc9dcc-214a-4dcc-9143-6bc8bbf943fe req-3d192399-019b-46e7-82ae-b8bbec60a341 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034421 Sep 06 16:18:53.604454 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 232/455] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:18:53.634508 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-04640600-785b-46f4-9832-95c205d9b187 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:53.643560 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-04640600-785b-46f4-9832-95c205d9b187 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.212899 Sep 06 16:18:53.644797 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 224/456] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:53 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:53.683663 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4cb6f609-1095-4266-a515-37afe4436c15 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:53.684331 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4cb6f609-1095-4266-a515-37afe4436c15 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:53.691726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4cb6f609-1095-4266-a515-37afe4436c15 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:53.692211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4cb6f609-1095-4266-a515-37afe4436c15 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:53.692640 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4cb6f609-1095-4266-a515-37afe4436c15 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:53.693364 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4cb6f609-1095-4266-a515-37afe4436c15 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:53.693814 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4cb6f609-1095-4266-a515-37afe4436c15 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:53.694261 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4cb6f609-1095-4266-a515-37afe4436c15 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:53.851508 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1986ebf8-7951-4084-ba06-b6d0430c0dad tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:53.852661 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1986ebf8-7951-4084-ba06-b6d0430c0dad tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:53.861170 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4cb6f609-1095-4266-a515-37afe4436c15 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:53.861824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1986ebf8-7951-4084-ba06-b6d0430c0dad tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:53.862487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1986ebf8-7951-4084-ba06-b6d0430c0dad tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:53.863992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1986ebf8-7951-4084-ba06-b6d0430c0dad tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:53.864940 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1986ebf8-7951-4084-ba06-b6d0430c0dad tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:53.866197 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1986ebf8-7951-4084-ba06-b6d0430c0dad tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:53.866796 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1986ebf8-7951-4084-ba06-b6d0430c0dad tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:53.870933 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4cb6f609-1095-4266-a515-37afe4436c15 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.190939 Sep 06 16:18:53.872010 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 233/457] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:53 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:53.959123 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1986ebf8-7951-4084-ba06-b6d0430c0dad tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:53.967676 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1986ebf8-7951-4084-ba06-b6d0430c0dad tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1272 microversion: 2.1 time: 0.125139 Sep 06 16:18:53.968265 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 225/458] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:53 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:54.668452 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7339b404-84c0-47cb-b153-8032e83ba73c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:54.669255 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7339b404-84c0-47cb-b153-8032e83ba73c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:54.675886 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7339b404-84c0-47cb-b153-8032e83ba73c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:54.676729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7339b404-84c0-47cb-b153-8032e83ba73c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:54.677110 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7339b404-84c0-47cb-b153-8032e83ba73c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:54.678226 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7339b404-84c0-47cb-b153-8032e83ba73c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:54.678934 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7339b404-84c0-47cb-b153-8032e83ba73c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:54.679434 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7339b404-84c0-47cb-b153-8032e83ba73c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:54.820272 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7339b404-84c0-47cb-b153-8032e83ba73c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:54.828491 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7339b404-84c0-47cb-b153-8032e83ba73c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.164576 Sep 06 16:18:54.829128 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 234/459] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:54 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:54.896464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a4a9a058-69ac-4067-b64b-9f26209a99e3 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:54.897269 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a4a9a058-69ac-4067-b64b-9f26209a99e3 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:54.905466 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a4a9a058-69ac-4067-b64b-9f26209a99e3 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:54.905942 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a4a9a058-69ac-4067-b64b-9f26209a99e3 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:54.906378 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a4a9a058-69ac-4067-b64b-9f26209a99e3 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:54.907084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a4a9a058-69ac-4067-b64b-9f26209a99e3 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:54.907626 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a4a9a058-69ac-4067-b64b-9f26209a99e3 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:54.908030 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a4a9a058-69ac-4067-b64b-9f26209a99e3 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:54.992241 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-320deef2-b6cd-4bc9-9485-e7f9d9a34615 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:54.993010 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-320deef2-b6cd-4bc9-9485-e7f9d9a34615 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:54.999910 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-320deef2-b6cd-4bc9-9485-e7f9d9a34615 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:55.000519 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-320deef2-b6cd-4bc9-9485-e7f9d9a34615 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:55.001043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-320deef2-b6cd-4bc9-9485-e7f9d9a34615 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:55.002249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-320deef2-b6cd-4bc9-9485-e7f9d9a34615 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:55.002894 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-320deef2-b6cd-4bc9-9485-e7f9d9a34615 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:55.003413 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-320deef2-b6cd-4bc9-9485-e7f9d9a34615 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:55.063058 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a4a9a058-69ac-4067-b64b-9f26209a99e3 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:55.071036 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a4a9a058-69ac-4067-b64b-9f26209a99e3 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1358 microversion: 2.1 time: 0.179478 Sep 06 16:18:55.072424 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 226/460] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:54 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:55.188893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-320deef2-b6cd-4bc9-9485-e7f9d9a34615 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:55.196781 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-320deef2-b6cd-4bc9-9485-e7f9d9a34615 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.209219 Sep 06 16:18:55.197355 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 235/461] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:54 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:55.855114 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-81d85ba6-e33f-4287-a133-b997b804b3e5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:55.856120 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-81d85ba6-e33f-4287-a133-b997b804b3e5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:55.868258 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-81d85ba6-e33f-4287-a133-b997b804b3e5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:55.868814 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-81d85ba6-e33f-4287-a133-b997b804b3e5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:55.869222 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-81d85ba6-e33f-4287-a133-b997b804b3e5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:55.874861 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-81d85ba6-e33f-4287-a133-b997b804b3e5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:55.875495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-81d85ba6-e33f-4287-a133-b997b804b3e5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:55.875946 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-81d85ba6-e33f-4287-a133-b997b804b3e5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:56.095380 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a8025caa-ed08-4152-8c38-4d12b03a1c29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:56.096735 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a8025caa-ed08-4152-8c38-4d12b03a1c29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:56.103595 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a8025caa-ed08-4152-8c38-4d12b03a1c29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:56.104436 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a8025caa-ed08-4152-8c38-4d12b03a1c29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:56.105211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a8025caa-ed08-4152-8c38-4d12b03a1c29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:56.106143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a8025caa-ed08-4152-8c38-4d12b03a1c29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:56.106891 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a8025caa-ed08-4152-8c38-4d12b03a1c29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:56.107672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a8025caa-ed08-4152-8c38-4d12b03a1c29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:56.132505 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-81d85ba6-e33f-4287-a133-b997b804b3e5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:56.145892 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-81d85ba6-e33f-4287-a133-b997b804b3e5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.296661 Sep 06 16:18:56.148064 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 227/462] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:55 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:56.227120 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1fd1f161-5fca-4ad9-b23e-67667c603625 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:56.228259 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1fd1f161-5fca-4ad9-b23e-67667c603625 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:56.235131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fd1f161-5fca-4ad9-b23e-67667c603625 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:56.235641 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fd1f161-5fca-4ad9-b23e-67667c603625 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:56.236542 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fd1f161-5fca-4ad9-b23e-67667c603625 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:56.237293 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fd1f161-5fca-4ad9-b23e-67667c603625 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:56.237876 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fd1f161-5fca-4ad9-b23e-67667c603625 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:56.238298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fd1f161-5fca-4ad9-b23e-67667c603625 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:56.321652 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a8025caa-ed08-4152-8c38-4d12b03a1c29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:56.340577 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a8025caa-ed08-4152-8c38-4d12b03a1c29 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1548 microversion: 2.1 time: 0.246898 Sep 06 16:18:56.343867 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 236/463] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:56 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1548 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:56.384098 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-06062b5a-25ab-4029-bd77-41dfa976d646 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:56.386000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-06062b5a-25ab-4029-bd77-41dfa976d646 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:56.397094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-06062b5a-25ab-4029-bd77-41dfa976d646 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:56.398190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-06062b5a-25ab-4029-bd77-41dfa976d646 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:56.398957 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-06062b5a-25ab-4029-bd77-41dfa976d646 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:56.400006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-06062b5a-25ab-4029-bd77-41dfa976d646 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:56.400601 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-06062b5a-25ab-4029-bd77-41dfa976d646 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:56.402604 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-06062b5a-25ab-4029-bd77-41dfa976d646 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:56.507746 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1fd1f161-5fca-4ad9-b23e-67667c603625 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:56.521833 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1fd1f161-5fca-4ad9-b23e-67667c603625 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.305269 Sep 06 16:18:56.522717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 228/464] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:56 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:56.527781 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-abf24ea1-0755-42c7-ba31-aeab2c7d180d req-d2d47e78-6869-4ee6-ab7a-90f93115d81d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de5cf7ef-d435-4db6-a52b-91466bef6028", "tag": "a0899bf2-7bef-4c09-b31b-ce93cf08d785"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:56.538406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-abf24ea1-0755-42c7-ba31-aeab2c7d180d req-d2d47e78-6869-4ee6-ab7a-90f93115d81d service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:56.539240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-abf24ea1-0755-42c7-ba31-aeab2c7d180d req-d2d47e78-6869-4ee6-ab7a-90f93115d81d service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:56.539670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-abf24ea1-0755-42c7-ba31-aeab2c7d180d req-d2d47e78-6869-4ee6-ab7a-90f93115d81d service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:56.551825 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-abf24ea1-0755-42c7-ba31-aeab2c7d180d req-d2d47e78-6869-4ee6-ab7a-90f93115d81d service nova] Creating event network-changed:a0899bf2-7bef-4c09-b31b-ce93cf08d785 for instance de5cf7ef-d435-4db6-a52b-91466bef6028 on hv-cinder-85221 Sep 06 16:18:56.557457 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-abf24ea1-0755-42c7-ba31-aeab2c7d180d req-d2d47e78-6869-4ee6-ab7a-90f93115d81d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033498 Sep 06 16:18:56.558337 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 229/465] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:56.645459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-06062b5a-25ab-4029-bd77-41dfa976d646 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:56.656223 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-06062b5a-25ab-4029-bd77-41dfa976d646 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1548 microversion: 2.1 time: 0.287157 Sep 06 16:18:56.657246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 237/466] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:56 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1548 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:56.688506 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ab02f82e-2077-4f5f-883f-a3c82623e75e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:56.694241 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ab02f82e-2077-4f5f-883f-a3c82623e75e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:56.694973 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ab02f82e-2077-4f5f-883f-a3c82623e75e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Searching by: {'deleted': False, 'project_id': '04bbe101d7ac40ab995da2159f3105cd'} {{(pid=120669) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 16:18:56.702157 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ab02f82e-2077-4f5f-883f-a3c82623e75e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:56.702631 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ab02f82e-2077-4f5f-883f-a3c82623e75e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:56.703056 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ab02f82e-2077-4f5f-883f-a3c82623e75e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:56.703799 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ab02f82e-2077-4f5f-883f-a3c82623e75e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:56.704294 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ab02f82e-2077-4f5f-883f-a3c82623e75e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:56.705017 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ab02f82e-2077-4f5f-883f-a3c82623e75e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:56.811647 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.multi_cell_list [None req-ab02f82e-2077-4f5f-883f-a3c82623e75e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120669) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 16:18:56.913837 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ab02f82e-2077-4f5f-883f-a3c82623e75e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.230461 Sep 06 16:18:56.914936 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 230/467] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Sep 6 16:18:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:56.928178 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4b5b693b-c169-4558-9b59-2e3f0fd1a104 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:56.928992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4b5b693b-c169-4558-9b59-2e3f0fd1a104 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:56.935959 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4b5b693b-c169-4558-9b59-2e3f0fd1a104 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:56.936445 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4b5b693b-c169-4558-9b59-2e3f0fd1a104 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:56.936928 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4b5b693b-c169-4558-9b59-2e3f0fd1a104 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:56.937596 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4b5b693b-c169-4558-9b59-2e3f0fd1a104 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:56.938034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4b5b693b-c169-4558-9b59-2e3f0fd1a104 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:56.938678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4b5b693b-c169-4558-9b59-2e3f0fd1a104 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:56.959732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:57.178747 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e71b4297-dd4a-49c0-8d9a-4c52fff13903 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:57.181742 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e71b4297-dd4a-49c0-8d9a-4c52fff13903 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:57.195597 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e71b4297-dd4a-49c0-8d9a-4c52fff13903 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:57.199210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e71b4297-dd4a-49c0-8d9a-4c52fff13903 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:57.200050 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e71b4297-dd4a-49c0-8d9a-4c52fff13903 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:57.201757 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e71b4297-dd4a-49c0-8d9a-4c52fff13903 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:57.206376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4b5b693b-c169-4558-9b59-2e3f0fd1a104 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:57.210400 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e71b4297-dd4a-49c0-8d9a-4c52fff13903 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:57.211201 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e71b4297-dd4a-49c0-8d9a-4c52fff13903 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:57.218733 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4b5b693b-c169-4558-9b59-2e3f0fd1a104 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1548 microversion: 2.1 time: 0.294303 Sep 06 16:18:57.229837 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 238/468] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:56 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1548 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:57.471838 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e71b4297-dd4a-49c0-8d9a-4c52fff13903 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:57.481840 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e71b4297-dd4a-49c0-8d9a-4c52fff13903 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.309218 Sep 06 16:18:57.482865 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 231/469] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:57 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:57.559543 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-46d4d6fa-875f-4e7a-8e52-2941212b782b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:57.560667 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-46d4d6fa-875f-4e7a-8e52-2941212b782b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:57.568387 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-46d4d6fa-875f-4e7a-8e52-2941212b782b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:57.569244 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-46d4d6fa-875f-4e7a-8e52-2941212b782b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:57.569870 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-46d4d6fa-875f-4e7a-8e52-2941212b782b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:57.570834 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-46d4d6fa-875f-4e7a-8e52-2941212b782b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:57.572842 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-46d4d6fa-875f-4e7a-8e52-2941212b782b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:57.575135 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-46d4d6fa-875f-4e7a-8e52-2941212b782b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:57.838476 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-46d4d6fa-875f-4e7a-8e52-2941212b782b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:57.849778 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-46d4d6fa-875f-4e7a-8e52-2941212b782b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.306306 Sep 06 16:18:57.850744 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 239/470] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:57 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:58.512079 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e69e7a45-e1e6-4be9-b3a4-6fef33fd24cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:58.513546 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e69e7a45-e1e6-4be9-b3a4-6fef33fd24cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:58.517726 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=80 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:58.524977 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e69e7a45-e1e6-4be9-b3a4-6fef33fd24cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:58.525723 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e69e7a45-e1e6-4be9-b3a4-6fef33fd24cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:58.526225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e69e7a45-e1e6-4be9-b3a4-6fef33fd24cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:58.527347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e69e7a45-e1e6-4be9-b3a4-6fef33fd24cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:58.527807 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e69e7a45-e1e6-4be9-b3a4-6fef33fd24cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:58.528226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e69e7a45-e1e6-4be9-b3a4-6fef33fd24cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:58.679390 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e69e7a45-e1e6-4be9-b3a4-6fef33fd24cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:58.688184 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e69e7a45-e1e6-4be9-b3a4-6fef33fd24cd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.183149 Sep 06 16:18:58.688891 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 232/471] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:58 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:58.883614 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d0ac7904-2263-4803-a468-52e2c83c847d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:58.885095 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d0ac7904-2263-4803-a468-52e2c83c847d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:58.895227 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d0ac7904-2263-4803-a468-52e2c83c847d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:58.896422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d0ac7904-2263-4803-a468-52e2c83c847d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:58.897438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d0ac7904-2263-4803-a468-52e2c83c847d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:58.898633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d0ac7904-2263-4803-a468-52e2c83c847d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:58.899566 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d0ac7904-2263-4803-a468-52e2c83c847d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:58.900284 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d0ac7904-2263-4803-a468-52e2c83c847d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:58.982762 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-df69d243-6e7a-4146-8303-4a55becb8903 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12f0583b-50cd-4e6c-a5ce-55501dec6742"}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:58.986001 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-df69d243-6e7a-4146-8303-4a55becb8903 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:58.992255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df69d243-6e7a-4146-8303-4a55becb8903 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:58.992733 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df69d243-6e7a-4146-8303-4a55becb8903 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:58.993184 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df69d243-6e7a-4146-8303-4a55becb8903 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:58.994055 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df69d243-6e7a-4146-8303-4a55becb8903 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:58.994648 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df69d243-6e7a-4146-8303-4a55becb8903 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:58.995068 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df69d243-6e7a-4146-8303-4a55becb8903 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:59.055550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d0ac7904-2263-4803-a468-52e2c83c847d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:59.063948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d0ac7904-2263-4803-a468-52e2c83c847d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.186296 Sep 06 16:18:59.064659 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 240/472] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:58 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:59.095782 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:59.711585 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-501bdf02-7b4e-45a6-955e-4c41364d0a71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:59.712186 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-501bdf02-7b4e-45a6-955e-4c41364d0a71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:59.720035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-501bdf02-7b4e-45a6-955e-4c41364d0a71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:59.720516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-501bdf02-7b4e-45a6-955e-4c41364d0a71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:59.721189 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-501bdf02-7b4e-45a6-955e-4c41364d0a71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:59.721874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-501bdf02-7b4e-45a6-955e-4c41364d0a71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:59.722319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-501bdf02-7b4e-45a6-955e-4c41364d0a71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:59.722732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-501bdf02-7b4e-45a6-955e-4c41364d0a71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:59.869543 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-501bdf02-7b4e-45a6-955e-4c41364d0a71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:59.878313 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-501bdf02-7b4e-45a6-955e-4c41364d0a71 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.170530 Sep 06 16:18:59.878904 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 241/473] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:59 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:00.087782 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-461277fc-510f-4b74-ad59-dbe27c6ae409 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:00.088524 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-461277fc-510f-4b74-ad59-dbe27c6ae409 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:00.094928 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-461277fc-510f-4b74-ad59-dbe27c6ae409 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:00.095464 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-461277fc-510f-4b74-ad59-dbe27c6ae409 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:00.095897 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-461277fc-510f-4b74-ad59-dbe27c6ae409 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:00.096588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-461277fc-510f-4b74-ad59-dbe27c6ae409 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:00.097069 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-461277fc-510f-4b74-ad59-dbe27c6ae409 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:00.097490 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-461277fc-510f-4b74-ad59-dbe27c6ae409 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:00.260233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-461277fc-510f-4b74-ad59-dbe27c6ae409 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:00.268594 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-461277fc-510f-4b74-ad59-dbe27c6ae409 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.184761 Sep 06 16:19:00.269258 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 242/474] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:00 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:00.603773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2042492239", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "networks": [{"uuid": "d1957dec-f3c3-45b6-aec6-f7cdd6e748ae"}]}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:00.660412 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.network.neutron [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] validate_networks() for [('d1957dec-f3c3-45b6-aec6-f7cdd6e748ae', None, None, None, None, None)] {{(pid=120668) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:19:01.035854 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Flavor limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:19:01.036246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Image limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:19:01.036732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Flavor pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:19:01.037155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Image pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:19:01.037556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:19:01.047811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:01.048366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:01.049015 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:01.049737 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:01.050181 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:01.050808 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:01.069098 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Getting quotas for project 89e0b5bdccf44702b0490185476f88b3. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:19:01.074398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Getting quotas for user fd9a6286db4945d4a052c40a5242d409 and project 89e0b5bdccf44702b0490185476f88b3. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:19:01.089553 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Going to run 1 instances... {{(pid=120668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:19:01.091877 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:19:01.139937 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-41236306-ee45-44e4-aaac-89ade6cf1d45 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540412 Sep 06 16:19:01.140822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 243/475] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:19:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:19:01.147544 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7da16d8c-2de2-478f-84db-877766f38e7c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:01.148142 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7da16d8c-2de2-478f-84db-877766f38e7c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:01.154428 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7da16d8c-2de2-478f-84db-877766f38e7c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:01.154909 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7da16d8c-2de2-478f-84db-877766f38e7c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:01.155339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7da16d8c-2de2-478f-84db-877766f38e7c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:01.156019 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7da16d8c-2de2-478f-84db-877766f38e7c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:01.156464 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7da16d8c-2de2-478f-84db-877766f38e7c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:01.156914 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7da16d8c-2de2-478f-84db-877766f38e7c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:01.346778 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7da16d8c-2de2-478f-84db-877766f38e7c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:01.354894 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7da16d8c-2de2-478f-84db-877766f38e7c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.212877 Sep 06 16:19:01.355618 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 244/476] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:01 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:01.382812 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4c60ab2c-e6cb-462b-a2f9-60ed4d9ddac9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:01.383835 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4c60ab2c-e6cb-462b-a2f9-60ed4d9ddac9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:01.446828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4c60ab2c-e6cb-462b-a2f9-60ed4d9ddac9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:01.456189 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4c60ab2c-e6cb-462b-a2f9-60ed4d9ddac9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1219 microversion: 2.1 time: 0.099579 Sep 06 16:19:01.457204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 245/477] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:01 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:01.463081 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fabae0e9-379a-464b-afc8-1a38c7ce8e73 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:01.464075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fabae0e9-379a-464b-afc8-1a38c7ce8e73 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:01.472268 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fabae0e9-379a-464b-afc8-1a38c7ce8e73 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:01.473267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fabae0e9-379a-464b-afc8-1a38c7ce8e73 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:01.474035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fabae0e9-379a-464b-afc8-1a38c7ce8e73 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:01.475094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fabae0e9-379a-464b-afc8-1a38c7ce8e73 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:01.475803 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fabae0e9-379a-464b-afc8-1a38c7ce8e73 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:01.476438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fabae0e9-379a-464b-afc8-1a38c7ce8e73 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:01.655013 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fabae0e9-379a-464b-afc8-1a38c7ce8e73 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:01.664510 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:01.666854 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fabae0e9-379a-464b-afc8-1a38c7ce8e73 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.207779 Sep 06 16:19:01.681443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 246/478] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:01 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:01.757727 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-df69d243-6e7a-4146-8303-4a55becb8903 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "POST /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.777620 Sep 06 16:19:01.758534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 233/479] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:18:58 2022] POST /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments => generated 194 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:19:02.386350 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-02624854-22d8-48bf-8366-1b268b782433 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:02.387256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-02624854-22d8-48bf-8366-1b268b782433 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:02.395911 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-02624854-22d8-48bf-8366-1b268b782433 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:02.396732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-02624854-22d8-48bf-8366-1b268b782433 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:02.397479 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-02624854-22d8-48bf-8366-1b268b782433 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:02.398603 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-02624854-22d8-48bf-8366-1b268b782433 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:02.399317 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-02624854-22d8-48bf-8366-1b268b782433 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:02.399915 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-02624854-22d8-48bf-8366-1b268b782433 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:02.486645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c3d2f05d-039b-4e53-a371-930d993a35a6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:02.487429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c3d2f05d-039b-4e53-a371-930d993a35a6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:02.494519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c3d2f05d-039b-4e53-a371-930d993a35a6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:02.495005 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c3d2f05d-039b-4e53-a371-930d993a35a6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:02.495440 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c3d2f05d-039b-4e53-a371-930d993a35a6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:02.496206 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c3d2f05d-039b-4e53-a371-930d993a35a6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:02.496629 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c3d2f05d-039b-4e53-a371-930d993a35a6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:02.497076 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c3d2f05d-039b-4e53-a371-930d993a35a6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:02.548194 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-02624854-22d8-48bf-8366-1b268b782433 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:02.556734 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-02624854-22d8-48bf-8366-1b268b782433 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.176231 Sep 06 16:19:02.557350 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 247/480] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:02 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:02.563165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c3d2f05d-039b-4e53-a371-930d993a35a6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:02.571635 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c3d2f05d-039b-4e53-a371-930d993a35a6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1223 microversion: 2.1 time: 0.089709 Sep 06 16:19:02.572192 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 234/481] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:02 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:02.694903 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0ccd0222-03ba-42dc-b6b9-e7c164dc7e1a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:02.695648 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0ccd0222-03ba-42dc-b6b9-e7c164dc7e1a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:02.703171 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0ccd0222-03ba-42dc-b6b9-e7c164dc7e1a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:02.703653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0ccd0222-03ba-42dc-b6b9-e7c164dc7e1a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:02.704076 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0ccd0222-03ba-42dc-b6b9-e7c164dc7e1a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:02.704793 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0ccd0222-03ba-42dc-b6b9-e7c164dc7e1a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:02.705244 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0ccd0222-03ba-42dc-b6b9-e7c164dc7e1a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:02.705771 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0ccd0222-03ba-42dc-b6b9-e7c164dc7e1a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:02.857337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0ccd0222-03ba-42dc-b6b9-e7c164dc7e1a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:02.872293 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0ccd0222-03ba-42dc-b6b9-e7c164dc7e1a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.181516 Sep 06 16:19:02.873116 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 248/482] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:02 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:03.583339 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e9bcc056-ef46-4bd0-a41a-5f55c134a594 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:03.583919 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e9bcc056-ef46-4bd0-a41a-5f55c134a594 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:03.591175 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9bcc056-ef46-4bd0-a41a-5f55c134a594 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:03.593269 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9bcc056-ef46-4bd0-a41a-5f55c134a594 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:03.593269 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9bcc056-ef46-4bd0-a41a-5f55c134a594 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:03.593269 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9bcc056-ef46-4bd0-a41a-5f55c134a594 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:03.593269 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9bcc056-ef46-4bd0-a41a-5f55c134a594 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:03.593757 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9bcc056-ef46-4bd0-a41a-5f55c134a594 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:03.595088 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e4857b4e-f767-41d3-9ef8-75f1e79db6fd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:03.595766 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e4857b4e-f767-41d3-9ef8-75f1e79db6fd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:03.602023 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4857b4e-f767-41d3-9ef8-75f1e79db6fd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:03.602515 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4857b4e-f767-41d3-9ef8-75f1e79db6fd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:03.602941 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4857b4e-f767-41d3-9ef8-75f1e79db6fd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:03.603637 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4857b4e-f767-41d3-9ef8-75f1e79db6fd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:03.607253 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4857b4e-f767-41d3-9ef8-75f1e79db6fd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:03.607253 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4857b4e-f767-41d3-9ef8-75f1e79db6fd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:03.739238 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e9bcc056-ef46-4bd0-a41a-5f55c134a594 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:03.748095 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e9bcc056-ef46-4bd0-a41a-5f55c134a594 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.169816 Sep 06 16:19:03.748830 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 235/483] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:03 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:03.874237 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e4857b4e-f767-41d3-9ef8-75f1e79db6fd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:03.882452 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e4857b4e-f767-41d3-9ef8-75f1e79db6fd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1223 microversion: 2.1 time: 0.291379 Sep 06 16:19:03.883044 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 249/484] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:03 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1223 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:03.899402 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-46d8269b-10cc-480e-8560-3c656c322a6e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:03.899866 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-46d8269b-10cc-480e-8560-3c656c322a6e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:03.907899 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-46d8269b-10cc-480e-8560-3c656c322a6e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:03.908391 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-46d8269b-10cc-480e-8560-3c656c322a6e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:03.909115 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-46d8269b-10cc-480e-8560-3c656c322a6e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:03.910268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-46d8269b-10cc-480e-8560-3c656c322a6e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:03.910781 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-46d8269b-10cc-480e-8560-3c656c322a6e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:03.911358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-46d8269b-10cc-480e-8560-3c656c322a6e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:04.048359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-46d8269b-10cc-480e-8560-3c656c322a6e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:04.056804 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-46d8269b-10cc-480e-8560-3c656c322a6e tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.164313 Sep 06 16:19:04.057385 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 236/485] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:03 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:04.771594 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-815c247d-d17d-47ad-81fe-e89dad09c3ca tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:04.772195 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-815c247d-d17d-47ad-81fe-e89dad09c3ca tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:04.780507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-815c247d-d17d-47ad-81fe-e89dad09c3ca tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:04.781318 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-815c247d-d17d-47ad-81fe-e89dad09c3ca tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:04.782006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-815c247d-d17d-47ad-81fe-e89dad09c3ca tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:04.783193 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-815c247d-d17d-47ad-81fe-e89dad09c3ca tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:04.783811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-815c247d-d17d-47ad-81fe-e89dad09c3ca tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:04.784229 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-815c247d-d17d-47ad-81fe-e89dad09c3ca tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:04.907003 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5af9dc8d-17a2-467d-8a89-f33ca2b2d083 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:04.907594 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5af9dc8d-17a2-467d-8a89-f33ca2b2d083 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:04.915207 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5af9dc8d-17a2-467d-8a89-f33ca2b2d083 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:04.915700 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5af9dc8d-17a2-467d-8a89-f33ca2b2d083 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:04.916150 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5af9dc8d-17a2-467d-8a89-f33ca2b2d083 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:04.916894 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5af9dc8d-17a2-467d-8a89-f33ca2b2d083 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:04.917338 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5af9dc8d-17a2-467d-8a89-f33ca2b2d083 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:04.917755 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5af9dc8d-17a2-467d-8a89-f33ca2b2d083 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:04.930529 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-815c247d-d17d-47ad-81fe-e89dad09c3ca tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:04.939289 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-815c247d-d17d-47ad-81fe-e89dad09c3ca tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.171654 Sep 06 16:19:04.939924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 250/486] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:04 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:04.987783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5af9dc8d-17a2-467d-8a89-f33ca2b2d083 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:04.996127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5af9dc8d-17a2-467d-8a89-f33ca2b2d083 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1223 microversion: 2.1 time: 0.093071 Sep 06 16:19:04.996710 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 237/487] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:04 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:05.082351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b49ef043-0865-49b1-9291-36020778798b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:05.082852 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b49ef043-0865-49b1-9291-36020778798b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:05.089638 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b49ef043-0865-49b1-9291-36020778798b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:05.090120 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b49ef043-0865-49b1-9291-36020778798b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:05.090542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b49ef043-0865-49b1-9291-36020778798b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:05.091230 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b49ef043-0865-49b1-9291-36020778798b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:05.091679 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b49ef043-0865-49b1-9291-36020778798b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:05.092090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b49ef043-0865-49b1-9291-36020778798b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:05.234249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b49ef043-0865-49b1-9291-36020778798b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:05.242342 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b49ef043-0865-49b1-9291-36020778798b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.164011 Sep 06 16:19:05.242919 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 251/488] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:05 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:05.963759 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8cb3c029-2b0f-4abb-8aad-d720b98a0cc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:05.964707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8cb3c029-2b0f-4abb-8aad-d720b98a0cc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:05.971832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8cb3c029-2b0f-4abb-8aad-d720b98a0cc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:05.972318 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8cb3c029-2b0f-4abb-8aad-d720b98a0cc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:05.972740 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8cb3c029-2b0f-4abb-8aad-d720b98a0cc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:05.973469 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8cb3c029-2b0f-4abb-8aad-d720b98a0cc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:05.973915 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8cb3c029-2b0f-4abb-8aad-d720b98a0cc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:05.974345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8cb3c029-2b0f-4abb-8aad-d720b98a0cc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:06.019785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d1394f0f-3fba-4378-af4d-3ee267cff823 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:06.020339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d1394f0f-3fba-4378-af4d-3ee267cff823 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:06.035753 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1394f0f-3fba-4378-af4d-3ee267cff823 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:06.036252 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1394f0f-3fba-4378-af4d-3ee267cff823 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:06.036689 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1394f0f-3fba-4378-af4d-3ee267cff823 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:06.037431 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1394f0f-3fba-4378-af4d-3ee267cff823 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:06.037882 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1394f0f-3fba-4378-af4d-3ee267cff823 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:06.038653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1394f0f-3fba-4378-af4d-3ee267cff823 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:06.106212 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d1394f0f-3fba-4378-af4d-3ee267cff823 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:06.114190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d1394f0f-3fba-4378-af4d-3ee267cff823 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1223 microversion: 2.1 time: 0.098293 Sep 06 16:19:06.114777 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 252/489] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:06 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:06.137722 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8cb3c029-2b0f-4abb-8aad-d720b98a0cc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:06.147390 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8cb3c029-2b0f-4abb-8aad-d720b98a0cc5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.187471 Sep 06 16:19:06.148107 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 238/490] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:05 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:06.267779 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-93980d06-a9f5-4920-a9d6-c92d8b3ea85b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:06.268987 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-93980d06-a9f5-4920-a9d6-c92d8b3ea85b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:06.279883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93980d06-a9f5-4920-a9d6-c92d8b3ea85b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:06.280808 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93980d06-a9f5-4920-a9d6-c92d8b3ea85b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:06.281531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93980d06-a9f5-4920-a9d6-c92d8b3ea85b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:06.282736 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93980d06-a9f5-4920-a9d6-c92d8b3ea85b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:06.283517 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93980d06-a9f5-4920-a9d6-c92d8b3ea85b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:06.284259 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93980d06-a9f5-4920-a9d6-c92d8b3ea85b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:06.440918 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-93980d06-a9f5-4920-a9d6-c92d8b3ea85b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:06.450000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-93980d06-a9f5-4920-a9d6-c92d8b3ea85b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.188156 Sep 06 16:19:06.461874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 253/491] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:06 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:07.138895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1d50da40-7ed8-437b-af3d-9083d119e127 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:07.139734 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1d50da40-7ed8-437b-af3d-9083d119e127 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:07.141534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:07.148023 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d50da40-7ed8-437b-af3d-9083d119e127 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:07.148682 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d50da40-7ed8-437b-af3d-9083d119e127 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:07.148922 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d50da40-7ed8-437b-af3d-9083d119e127 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:07.149650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d50da40-7ed8-437b-af3d-9083d119e127 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:07.150102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d50da40-7ed8-437b-af3d-9083d119e127 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:07.150522 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d50da40-7ed8-437b-af3d-9083d119e127 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:07.171583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-34c93fff-39e0-4a7c-9c1e-24e6a9be4bf0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:07.172980 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-34c93fff-39e0-4a7c-9c1e-24e6a9be4bf0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:07.179431 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34c93fff-39e0-4a7c-9c1e-24e6a9be4bf0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:07.179919 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34c93fff-39e0-4a7c-9c1e-24e6a9be4bf0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:07.180347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34c93fff-39e0-4a7c-9c1e-24e6a9be4bf0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:07.181112 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34c93fff-39e0-4a7c-9c1e-24e6a9be4bf0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:07.181548 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34c93fff-39e0-4a7c-9c1e-24e6a9be4bf0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:07.181966 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34c93fff-39e0-4a7c-9c1e-24e6a9be4bf0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:07.216087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1d50da40-7ed8-437b-af3d-9083d119e127 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:07.224238 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1d50da40-7ed8-437b-af3d-9083d119e127 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1215 microversion: 2.1 time: 0.089463 Sep 06 16:19:07.224881 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 239/492] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:07 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:07.318520 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-34c93fff-39e0-4a7c-9c1e-24e6a9be4bf0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:07.326703 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-34c93fff-39e0-4a7c-9c1e-24e6a9be4bf0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.158962 Sep 06 16:19:07.327278 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 254/493] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:07 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:07.475213 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-dd0ae52b-186f-4c17-898f-93e74ae34b7c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:07.475714 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-dd0ae52b-186f-4c17-898f-93e74ae34b7c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:07.482201 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dd0ae52b-186f-4c17-898f-93e74ae34b7c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:07.482680 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dd0ae52b-186f-4c17-898f-93e74ae34b7c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:07.483111 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dd0ae52b-186f-4c17-898f-93e74ae34b7c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:07.483810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dd0ae52b-186f-4c17-898f-93e74ae34b7c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:07.484254 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dd0ae52b-186f-4c17-898f-93e74ae34b7c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:07.484707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dd0ae52b-186f-4c17-898f-93e74ae34b7c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:07.615978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-dd0ae52b-186f-4c17-898f-93e74ae34b7c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:07.624270 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-dd0ae52b-186f-4c17-898f-93e74ae34b7c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.153397 Sep 06 16:19:07.624874 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 240/494] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:07 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:08.247797 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c77fc7e0-4989-49e3-928f-4b6eec0f27e9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:08.248449 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c77fc7e0-4989-49e3-928f-4b6eec0f27e9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:08.257750 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c77fc7e0-4989-49e3-928f-4b6eec0f27e9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:08.258234 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c77fc7e0-4989-49e3-928f-4b6eec0f27e9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:08.258654 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c77fc7e0-4989-49e3-928f-4b6eec0f27e9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:08.259420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c77fc7e0-4989-49e3-928f-4b6eec0f27e9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:08.259794 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c77fc7e0-4989-49e3-928f-4b6eec0f27e9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:08.260206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c77fc7e0-4989-49e3-928f-4b6eec0f27e9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:08.329428 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c77fc7e0-4989-49e3-928f-4b6eec0f27e9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:08.341991 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c77fc7e0-4989-49e3-928f-4b6eec0f27e9 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1215 microversion: 2.1 time: 0.097916 Sep 06 16:19:08.342767 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 255/495] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:08 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:08.354786 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-96b8a9ae-7e8f-40c0-8ef0-6125f450a353 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:08.355788 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-96b8a9ae-7e8f-40c0-8ef0-6125f450a353 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:08.365289 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-96b8a9ae-7e8f-40c0-8ef0-6125f450a353 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:08.365976 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-96b8a9ae-7e8f-40c0-8ef0-6125f450a353 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:08.366631 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-96b8a9ae-7e8f-40c0-8ef0-6125f450a353 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:08.367650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-96b8a9ae-7e8f-40c0-8ef0-6125f450a353 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:08.368325 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-96b8a9ae-7e8f-40c0-8ef0-6125f450a353 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:08.368964 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-96b8a9ae-7e8f-40c0-8ef0-6125f450a353 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:08.511045 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-96b8a9ae-7e8f-40c0-8ef0-6125f450a353 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:08.519082 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-96b8a9ae-7e8f-40c0-8ef0-6125f450a353 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.169545 Sep 06 16:19:08.519654 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 241/496] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:08 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:08.648009 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-529a4cbe-0ff9-4ad0-bee2-d9ef87805e7d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:08.648621 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-529a4cbe-0ff9-4ad0-bee2-d9ef87805e7d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:08.655191 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-529a4cbe-0ff9-4ad0-bee2-d9ef87805e7d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:08.655678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-529a4cbe-0ff9-4ad0-bee2-d9ef87805e7d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:08.656114 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-529a4cbe-0ff9-4ad0-bee2-d9ef87805e7d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:08.656830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-529a4cbe-0ff9-4ad0-bee2-d9ef87805e7d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:08.657305 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-529a4cbe-0ff9-4ad0-bee2-d9ef87805e7d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:08.657726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-529a4cbe-0ff9-4ad0-bee2-d9ef87805e7d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:08.801276 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-529a4cbe-0ff9-4ad0-bee2-d9ef87805e7d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:08.804665 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:08.811066 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-529a4cbe-0ff9-4ad0-bee2-d9ef87805e7d tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.167058 Sep 06 16:19:08.811643 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 256/497] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:08 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:09.367190 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e9a44e83-bd74-4e0c-b0af-1d6870d575bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:09.367834 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e9a44e83-bd74-4e0c-b0af-1d6870d575bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:09.374628 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9a44e83-bd74-4e0c-b0af-1d6870d575bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:09.375165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9a44e83-bd74-4e0c-b0af-1d6870d575bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:09.375887 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9a44e83-bd74-4e0c-b0af-1d6870d575bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:09.377075 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9a44e83-bd74-4e0c-b0af-1d6870d575bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:09.378055 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9a44e83-bd74-4e0c-b0af-1d6870d575bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:09.378704 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9a44e83-bd74-4e0c-b0af-1d6870d575bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:09.444719 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e9a44e83-bd74-4e0c-b0af-1d6870d575bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:09.453017 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e9a44e83-bd74-4e0c-b0af-1d6870d575bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1215 microversion: 2.1 time: 0.089644 Sep 06 16:19:09.453616 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 242/498] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:09 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:09.543792 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2adbc97a-086f-40d8-bd70-e8cd8caa94b9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:09.544391 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2adbc97a-086f-40d8-bd70-e8cd8caa94b9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:09.546626 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:09.552602 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2adbc97a-086f-40d8-bd70-e8cd8caa94b9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:09.553098 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2adbc97a-086f-40d8-bd70-e8cd8caa94b9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:09.553540 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2adbc97a-086f-40d8-bd70-e8cd8caa94b9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:09.554226 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2adbc97a-086f-40d8-bd70-e8cd8caa94b9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:09.554664 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2adbc97a-086f-40d8-bd70-e8cd8caa94b9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:09.555079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2adbc97a-086f-40d8-bd70-e8cd8caa94b9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:09.698082 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2adbc97a-086f-40d8-bd70-e8cd8caa94b9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:09.706076 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2adbc97a-086f-40d8-bd70-e8cd8caa94b9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.166145 Sep 06 16:19:09.706642 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 257/499] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:09 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:09.836572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-80d98fc8-6069-4594-a412-98a13c904e15 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:09.837126 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-80d98fc8-6069-4594-a412-98a13c904e15 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:09.843452 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80d98fc8-6069-4594-a412-98a13c904e15 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:09.843933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80d98fc8-6069-4594-a412-98a13c904e15 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:09.844356 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80d98fc8-6069-4594-a412-98a13c904e15 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:09.845086 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80d98fc8-6069-4594-a412-98a13c904e15 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:09.845531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80d98fc8-6069-4594-a412-98a13c904e15 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:09.845948 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80d98fc8-6069-4594-a412-98a13c904e15 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:09.986261 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-80d98fc8-6069-4594-a412-98a13c904e15 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:09.994610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-80d98fc8-6069-4594-a412-98a13c904e15 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.162025 Sep 06 16:19:09.995188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 243/500] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:09 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:10.476633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-67c501a6-d02d-45f1-9be5-3d452dd9b9a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:10.477265 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-67c501a6-d02d-45f1-9be5-3d452dd9b9a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:10.484225 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-67c501a6-d02d-45f1-9be5-3d452dd9b9a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:10.484712 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-67c501a6-d02d-45f1-9be5-3d452dd9b9a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:10.485170 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-67c501a6-d02d-45f1-9be5-3d452dd9b9a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:10.485867 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-67c501a6-d02d-45f1-9be5-3d452dd9b9a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:10.486313 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-67c501a6-d02d-45f1-9be5-3d452dd9b9a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:10.486729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-67c501a6-d02d-45f1-9be5-3d452dd9b9a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:10.559042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-67c501a6-d02d-45f1-9be5-3d452dd9b9a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:10.567689 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-67c501a6-d02d-45f1-9be5-3d452dd9b9a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1215 microversion: 2.1 time: 0.095134 Sep 06 16:19:10.568264 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 258/501] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:10 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:10.735017 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-10b0132e-f2df-4712-bb09-237c143a3415 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:10.735605 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-10b0132e-f2df-4712-bb09-237c143a3415 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:10.742759 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10b0132e-f2df-4712-bb09-237c143a3415 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:10.743224 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10b0132e-f2df-4712-bb09-237c143a3415 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:10.743650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10b0132e-f2df-4712-bb09-237c143a3415 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:10.744367 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10b0132e-f2df-4712-bb09-237c143a3415 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:10.744806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10b0132e-f2df-4712-bb09-237c143a3415 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:10.745223 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10b0132e-f2df-4712-bb09-237c143a3415 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:10.882565 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-10b0132e-f2df-4712-bb09-237c143a3415 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:10.890910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-10b0132e-f2df-4712-bb09-237c143a3415 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.159807 Sep 06 16:19:10.891468 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 244/502] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:10 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:11.022755 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-96d60d67-6b67-4a6c-b77e-05708a0918aa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:11.023357 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-96d60d67-6b67-4a6c-b77e-05708a0918aa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:11.030276 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96d60d67-6b67-4a6c-b77e-05708a0918aa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:11.030772 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96d60d67-6b67-4a6c-b77e-05708a0918aa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:11.031203 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96d60d67-6b67-4a6c-b77e-05708a0918aa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:11.031902 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96d60d67-6b67-4a6c-b77e-05708a0918aa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:11.032353 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96d60d67-6b67-4a6c-b77e-05708a0918aa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:11.032798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96d60d67-6b67-4a6c-b77e-05708a0918aa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:11.060808 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=4 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:11.178548 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-96d60d67-6b67-4a6c-b77e-05708a0918aa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:11.191443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-96d60d67-6b67-4a6c-b77e-05708a0918aa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.175805 Sep 06 16:19:11.192181 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 259/503] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:11 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:11.591126 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ac6fa70a-86cc-4bc3-a121-a62fdfa2f763 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:11.591727 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ac6fa70a-86cc-4bc3-a121-a62fdfa2f763 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:11.598172 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac6fa70a-86cc-4bc3-a121-a62fdfa2f763 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:11.598655 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac6fa70a-86cc-4bc3-a121-a62fdfa2f763 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:11.599081 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac6fa70a-86cc-4bc3-a121-a62fdfa2f763 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:11.599801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac6fa70a-86cc-4bc3-a121-a62fdfa2f763 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:11.600246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac6fa70a-86cc-4bc3-a121-a62fdfa2f763 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:11.600660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ac6fa70a-86cc-4bc3-a121-a62fdfa2f763 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:11.917968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4e46ee89-3fd9-4841-8859-9890af58f83a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:11.917968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4e46ee89-3fd9-4841-8859-9890af58f83a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:11.917968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=14 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:11.925338 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e46ee89-3fd9-4841-8859-9890af58f83a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:11.925839 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e46ee89-3fd9-4841-8859-9890af58f83a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:11.926279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e46ee89-3fd9-4841-8859-9890af58f83a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:11.926989 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e46ee89-3fd9-4841-8859-9890af58f83a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:11.927445 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e46ee89-3fd9-4841-8859-9890af58f83a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:11.927854 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ac6fa70a-86cc-4bc3-a121-a62fdfa2f763 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:11.928332 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e46ee89-3fd9-4841-8859-9890af58f83a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:11.940495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ac6fa70a-86cc-4bc3-a121-a62fdfa2f763 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1215 microversion: 2.1 time: 0.352853 Sep 06 16:19:11.950826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 245/504] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:11 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1215 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:12.078499 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4e46ee89-3fd9-4841-8859-9890af58f83a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:12.087544 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4e46ee89-3fd9-4841-8859-9890af58f83a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.177542 Sep 06 16:19:12.088127 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 260/505] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:11 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:12.216400 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5109ef55-f6dc-46db-acbd-6cc11bbba695 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:12.217415 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5109ef55-f6dc-46db-acbd-6cc11bbba695 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:12.225598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5109ef55-f6dc-46db-acbd-6cc11bbba695 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:12.226051 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5109ef55-f6dc-46db-acbd-6cc11bbba695 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:12.226520 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5109ef55-f6dc-46db-acbd-6cc11bbba695 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:12.227222 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5109ef55-f6dc-46db-acbd-6cc11bbba695 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:12.227666 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5109ef55-f6dc-46db-acbd-6cc11bbba695 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:12.228089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5109ef55-f6dc-46db-acbd-6cc11bbba695 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:12.365169 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5109ef55-f6dc-46db-acbd-6cc11bbba695 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:12.373286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5109ef55-f6dc-46db-acbd-6cc11bbba695 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.162013 Sep 06 16:19:12.374056 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 246/506] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:12 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:12.564020 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-8d98e569-a3a0-4c99-a4e4-202a604dc019 req-14f24834-1c77-4caf-bc47-3eeae7248543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de5cf7ef-d435-4db6-a52b-91466bef6028", "name": "network-vif-plugged", "status": "completed", "tag": "a0899bf2-7bef-4c09-b31b-ce93cf08d785"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:12.574683 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-8d98e569-a3a0-4c99-a4e4-202a604dc019 req-14f24834-1c77-4caf-bc47-3eeae7248543 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:12.575375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-8d98e569-a3a0-4c99-a4e4-202a604dc019 req-14f24834-1c77-4caf-bc47-3eeae7248543 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:12.575845 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-8d98e569-a3a0-4c99-a4e4-202a604dc019 req-14f24834-1c77-4caf-bc47-3eeae7248543 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:12.589001 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-8d98e569-a3a0-4c99-a4e4-202a604dc019 req-14f24834-1c77-4caf-bc47-3eeae7248543 service nova] Creating event network-vif-plugged:a0899bf2-7bef-4c09-b31b-ce93cf08d785 for instance de5cf7ef-d435-4db6-a52b-91466bef6028 on hv-cinder-85221 Sep 06 16:19:12.594421 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-8d98e569-a3a0-4c99-a4e4-202a604dc019 req-14f24834-1c77-4caf-bc47-3eeae7248543 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Sep 06 16:19:12.595043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 261/507] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:19:12.964383 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-35a5e157-825f-4726-a207-c0ae16716178 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:12.965162 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-35a5e157-825f-4726-a207-c0ae16716178 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:12.972392 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35a5e157-825f-4726-a207-c0ae16716178 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:12.973114 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35a5e157-825f-4726-a207-c0ae16716178 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:12.973547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35a5e157-825f-4726-a207-c0ae16716178 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:12.974345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35a5e157-825f-4726-a207-c0ae16716178 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:12.974921 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35a5e157-825f-4726-a207-c0ae16716178 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:12.975425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35a5e157-825f-4726-a207-c0ae16716178 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:13.042623 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-35a5e157-825f-4726-a207-c0ae16716178 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:13.050548 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-35a5e157-825f-4726-a207-c0ae16716178 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1271 microversion: 2.1 time: 0.090975 Sep 06 16:19:13.051213 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 247/508] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:12 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:13.111572 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4e3c92b9-7298-49ed-8950-f60492484627 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:13.112431 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4e3c92b9-7298-49ed-8950-f60492484627 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:13.121022 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e3c92b9-7298-49ed-8950-f60492484627 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:13.121600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e3c92b9-7298-49ed-8950-f60492484627 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:13.122094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e3c92b9-7298-49ed-8950-f60492484627 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:13.123058 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e3c92b9-7298-49ed-8950-f60492484627 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:13.123763 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e3c92b9-7298-49ed-8950-f60492484627 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:13.124358 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e3c92b9-7298-49ed-8950-f60492484627 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:13.272603 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4e3c92b9-7298-49ed-8950-f60492484627 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:13.288812 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4e3c92b9-7298-49ed-8950-f60492484627 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1503 microversion: 2.1 time: 0.181269 Sep 06 16:19:13.289411 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 262/509] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:13 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:13.312238 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-880c5424-5678-4462-8818-b37d60ef9ef5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bea5e21-fec8-4536-9613-66ce20088dce"}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:13.314965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-880c5424-5678-4462-8818-b37d60ef9ef5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:13.321820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-880c5424-5678-4462-8818-b37d60ef9ef5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:13.322434 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-880c5424-5678-4462-8818-b37d60ef9ef5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:13.322900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-880c5424-5678-4462-8818-b37d60ef9ef5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:13.323717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-880c5424-5678-4462-8818-b37d60ef9ef5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:13.324264 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-880c5424-5678-4462-8818-b37d60ef9ef5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:13.325005 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-880c5424-5678-4462-8818-b37d60ef9ef5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:13.355543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-880c5424-5678-4462-8818-b37d60ef9ef5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] HTTP exception thrown: Cannot 'attach_volume' instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 while it is in vm_state rescued Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-880c5424-5678-4462-8818-b37d60ef9ef5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Request method failure captured: Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: POST /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9/os-volume_attachments HTTP/1.1 Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 74 Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3JE-mvXJfafJGdfInwGWFXyX8vm1TCi2ot3YdwYrF-4Edt8_xnBZLKdft-iOh0bGqcZkuWHUjnbHFyY4JyAcYYwqblm10OkwpxcwVN1Q9ztdopxT5kE1EybmUKrN1PEAiAMDv4KZA1PhL7NR0vL4LK6Q15ypGJ6vu_af7tN1gEPvCI Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 49a3e0cfba224a119bf8aaf26ae583f4 Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:19:13.357347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:19:13.358893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:19:13.358893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:19:13.358893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 49a3e0cfba224a119bf8aaf26ae583f4 Sep 06 16:19:13.358893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:19:13.358893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-ServerRescueNegativeTestJSON-843887898-project Sep 06 16:19:13.358893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:19:13.358893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:19:13.358893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 93096a58fcb34f2085a05ffa40df5937 Sep 06 16:19:13.358893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-ServerRescueNegativeTestJSON-843887898-project Sep 06 16:19:13.358893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Sep 06 16:19:13.358893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {"volumeAttachment": {"volumeId": "0bea5e21-fec8-4536-9613-66ce20088dce"}} Sep 06 16:19:13.358893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Cannot 'attach_volume' instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 while it is in vm_state rescued Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'server_id': '18d1b8c7-0e2d-4897-9945-2c9b6dec52a9', 'body': {'volumeAttachment': {'volumeId': '0bea5e21-fec8-4536-9613-66ce20088dce'}}} Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:19:13.359705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 while it is in vm_state rescued Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:19:13.360969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:19:13.362324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:19:13.362324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:19:13.362324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 while it is in vm_state rescued Sep 06 16:19:13.362324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:19:13.362324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-880c5424-5678-4462-8818-b37d60ef9ef5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Returning 409 to user: Cannot 'attach_volume' instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 while it is in vm_state rescued {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:19:13.362324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-880c5424-5678-4462-8818-b37d60ef9ef5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "POST /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051154 Sep 06 16:19:13.362324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 248/510] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:19:13 2022] POST /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 16:19:13.368856 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ad547070-19a0-4c0c-b686-fb1c54c80d43 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:13.369423 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ad547070-19a0-4c0c-b686-fb1c54c80d43 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:13.376314 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad547070-19a0-4c0c-b686-fb1c54c80d43 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:13.377052 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad547070-19a0-4c0c-b686-fb1c54c80d43 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:13.377769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad547070-19a0-4c0c-b686-fb1c54c80d43 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:13.378921 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad547070-19a0-4c0c-b686-fb1c54c80d43 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:13.379575 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad547070-19a0-4c0c-b686-fb1c54c80d43 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:13.380040 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad547070-19a0-4c0c-b686-fb1c54c80d43 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:13.396264 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-739597d0-6257-4e0d-946b-0322e66bcbc2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:13.396930 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-739597d0-6257-4e0d-946b-0322e66bcbc2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:13.403642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-739597d0-6257-4e0d-946b-0322e66bcbc2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:13.404228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-739597d0-6257-4e0d-946b-0322e66bcbc2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:13.404651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-739597d0-6257-4e0d-946b-0322e66bcbc2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:13.405371 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-739597d0-6257-4e0d-946b-0322e66bcbc2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:13.405826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-739597d0-6257-4e0d-946b-0322e66bcbc2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:13.406346 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-739597d0-6257-4e0d-946b-0322e66bcbc2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:13.427670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:13.453867 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ad547070-19a0-4c0c-b686-fb1c54c80d43 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "POST /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9/action" status: 202 len: 0 microversion: 2.1 time: 0.088994 Sep 06 16:19:13.454507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 263/511] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:19:13 2022] POST /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:19:13.463325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4d0feed6-2b38-4c25-ad94-a024d247865f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:13.464032 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4d0feed6-2b38-4c25-ad94-a024d247865f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:13.473744 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d0feed6-2b38-4c25-ad94-a024d247865f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:13.474505 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d0feed6-2b38-4c25-ad94-a024d247865f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:13.474934 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d0feed6-2b38-4c25-ad94-a024d247865f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:13.475626 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d0feed6-2b38-4c25-ad94-a024d247865f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:13.477218 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d0feed6-2b38-4c25-ad94-a024d247865f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:13.477218 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d0feed6-2b38-4c25-ad94-a024d247865f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:13.550160 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-739597d0-6257-4e0d-946b-0322e66bcbc2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:13.558495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-739597d0-6257-4e0d-946b-0322e66bcbc2 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.166114 Sep 06 16:19:13.560806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 249/512] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:13 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:13.622187 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4d0feed6-2b38-4c25-ad94-a024d247865f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:13.630258 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4d0feed6-2b38-4c25-ad94-a024d247865f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1511 microversion: 2.1 time: 0.170984 Sep 06 16:19:13.630820 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 264/513] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:13 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:14.074810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c90c634a-28f3-4372-b110-2ad4f733e701 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:14.075435 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c90c634a-28f3-4372-b110-2ad4f733e701 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:14.083229 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c90c634a-28f3-4372-b110-2ad4f733e701 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:14.083857 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c90c634a-28f3-4372-b110-2ad4f733e701 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:14.084296 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c90c634a-28f3-4372-b110-2ad4f733e701 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:14.085107 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c90c634a-28f3-4372-b110-2ad4f733e701 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:14.085647 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c90c634a-28f3-4372-b110-2ad4f733e701 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:14.086184 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c90c634a-28f3-4372-b110-2ad4f733e701 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:14.168384 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c90c634a-28f3-4372-b110-2ad4f733e701 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:14.178319 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c90c634a-28f3-4372-b110-2ad4f733e701 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1279 microversion: 2.1 time: 0.106106 Sep 06 16:19:14.182522 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 250/514] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:14 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1279 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:14.583813 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-cfcf21db-22c0-4033-b73a-d71fe867b464 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:14.584402 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-cfcf21db-22c0-4033-b73a-d71fe867b464 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:14.592464 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cfcf21db-22c0-4033-b73a-d71fe867b464 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:14.592997 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cfcf21db-22c0-4033-b73a-d71fe867b464 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:14.593423 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cfcf21db-22c0-4033-b73a-d71fe867b464 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:14.594081 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cfcf21db-22c0-4033-b73a-d71fe867b464 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:14.594557 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cfcf21db-22c0-4033-b73a-d71fe867b464 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:14.594976 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cfcf21db-22c0-4033-b73a-d71fe867b464 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:14.654629 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5c68f92b-3d9f-47c0-8137-f8b7afa28515 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:14.656279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5c68f92b-3d9f-47c0-8137-f8b7afa28515 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:14.663756 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c68f92b-3d9f-47c0-8137-f8b7afa28515 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:14.664216 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c68f92b-3d9f-47c0-8137-f8b7afa28515 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:14.664681 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c68f92b-3d9f-47c0-8137-f8b7afa28515 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:14.665482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c68f92b-3d9f-47c0-8137-f8b7afa28515 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:14.665936 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c68f92b-3d9f-47c0-8137-f8b7afa28515 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:14.666439 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c68f92b-3d9f-47c0-8137-f8b7afa28515 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:14.733785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cfcf21db-22c0-4033-b73a-d71fe867b464 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:14.742182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-cfcf21db-22c0-4033-b73a-d71fe867b464 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1314 microversion: 2.1 time: 0.162418 Sep 06 16:19:14.743114 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 265/515] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:14 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:14.918010 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5c68f92b-3d9f-47c0-8137-f8b7afa28515 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:14.926912 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5c68f92b-3d9f-47c0-8137-f8b7afa28515 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1511 microversion: 2.1 time: 0.276555 Sep 06 16:19:14.927745 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 251/516] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:14 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:15.202967 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7cdec66e-6700-4bcf-a951-1a83b10e5230 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:15.204615 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7cdec66e-6700-4bcf-a951-1a83b10e5230 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:15.216856 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7cdec66e-6700-4bcf-a951-1a83b10e5230 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:15.216856 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7cdec66e-6700-4bcf-a951-1a83b10e5230 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:15.216856 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7cdec66e-6700-4bcf-a951-1a83b10e5230 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:15.216856 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7cdec66e-6700-4bcf-a951-1a83b10e5230 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:15.217425 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7cdec66e-6700-4bcf-a951-1a83b10e5230 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:15.217425 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7cdec66e-6700-4bcf-a951-1a83b10e5230 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:15.335500 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7cdec66e-6700-4bcf-a951-1a83b10e5230 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:15.346056 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7cdec66e-6700-4bcf-a951-1a83b10e5230 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1277 microversion: 2.1 time: 0.147422 Sep 06 16:19:15.362160 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 266/517] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:15 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:15.767030 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e7c4a0c6-55d0-4c4a-a41e-65c121a7ac9b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:15.767647 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e7c4a0c6-55d0-4c4a-a41e-65c121a7ac9b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:15.777227 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c4a0c6-55d0-4c4a-a41e-65c121a7ac9b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:15.778755 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c4a0c6-55d0-4c4a-a41e-65c121a7ac9b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:15.779290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c4a0c6-55d0-4c4a-a41e-65c121a7ac9b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:15.780992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c4a0c6-55d0-4c4a-a41e-65c121a7ac9b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:15.781668 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c4a0c6-55d0-4c4a-a41e-65c121a7ac9b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:15.782290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c4a0c6-55d0-4c4a-a41e-65c121a7ac9b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:15.951621 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-673efe04-6f1a-4ae6-b74a-25e8b6f05ef0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:15.952463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-673efe04-6f1a-4ae6-b74a-25e8b6f05ef0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:15.955695 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:19:15.955882 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Tue Sep 6 16:19:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 (ip 10.222.0.43) !!! Sep 06 16:19:15.960625 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-673efe04-6f1a-4ae6-b74a-25e8b6f05ef0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:15.963357 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-673efe04-6f1a-4ae6-b74a-25e8b6f05ef0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:15.963357 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-673efe04-6f1a-4ae6-b74a-25e8b6f05ef0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:15.963357 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-673efe04-6f1a-4ae6-b74a-25e8b6f05ef0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:15.963357 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-673efe04-6f1a-4ae6-b74a-25e8b6f05ef0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:15.964035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-673efe04-6f1a-4ae6-b74a-25e8b6f05ef0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:16.060437 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e7c4a0c6-55d0-4c4a-a41e-65c121a7ac9b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:16.071390 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e7c4a0c6-55d0-4c4a-a41e-65c121a7ac9b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1498 microversion: 2.1 time: 0.309967 Sep 06 16:19:16.072119 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 252/518] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:15 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1498 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:16.116660 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-673efe04-6f1a-4ae6-b74a-25e8b6f05ef0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:16.124808 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-673efe04-6f1a-4ae6-b74a-25e8b6f05ef0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1511 microversion: 2.1 time: 0.177195 Sep 06 16:19:16.125391 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 267/519] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:15 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:16.369519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a83073c6-6b8a-460a-8ee9-17fda6d6fea8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:16.370241 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a83073c6-6b8a-460a-8ee9-17fda6d6fea8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:16.376610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a83073c6-6b8a-460a-8ee9-17fda6d6fea8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:16.377209 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a83073c6-6b8a-460a-8ee9-17fda6d6fea8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:16.377708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a83073c6-6b8a-460a-8ee9-17fda6d6fea8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:16.378473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a83073c6-6b8a-460a-8ee9-17fda6d6fea8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:16.379091 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a83073c6-6b8a-460a-8ee9-17fda6d6fea8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:16.379583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a83073c6-6b8a-460a-8ee9-17fda6d6fea8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:16.676089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a83073c6-6b8a-460a-8ee9-17fda6d6fea8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:16.697254 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a83073c6-6b8a-460a-8ee9-17fda6d6fea8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.331925 Sep 06 16:19:16.698071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 253/520] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:16 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:16.788565 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ececfd1e-d2a7-4578-8266-212fe5329dfa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:16.789281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ececfd1e-d2a7-4578-8266-212fe5329dfa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:16.797038 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ececfd1e-d2a7-4578-8266-212fe5329dfa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:16.797591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ececfd1e-d2a7-4578-8266-212fe5329dfa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:16.797996 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ececfd1e-d2a7-4578-8266-212fe5329dfa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:16.799221 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ececfd1e-d2a7-4578-8266-212fe5329dfa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:16.799732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ececfd1e-d2a7-4578-8266-212fe5329dfa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:16.800419 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ececfd1e-d2a7-4578-8266-212fe5329dfa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:16.850757 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ececfd1e-d2a7-4578-8266-212fe5329dfa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Going to try to terminate instance {{(pid=120668) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:19:16.946673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ececfd1e-d2a7-4578-8266-212fe5329dfa tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "DELETE /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 204 len: 0 microversion: 2.1 time: 0.161883 Sep 06 16:19:16.947635 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 268/521] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:19:16 2022] DELETE /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:19:16.956630 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c08d48df-e51b-4d79-ac9d-61f519eb10fb tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:16.958454 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c08d48df-e51b-4d79-ac9d-61f519eb10fb tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:16.965370 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c08d48df-e51b-4d79-ac9d-61f519eb10fb tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:16.965868 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c08d48df-e51b-4d79-ac9d-61f519eb10fb tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:16.966303 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c08d48df-e51b-4d79-ac9d-61f519eb10fb tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:16.967051 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c08d48df-e51b-4d79-ac9d-61f519eb10fb tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:16.967534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c08d48df-e51b-4d79-ac9d-61f519eb10fb tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:16.967992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c08d48df-e51b-4d79-ac9d-61f519eb10fb tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:17.049307 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-8d51da77-2eba-4157-b0b0-e630c43f2ab2 req-cb456f23-7844-4a3c-a52a-632a3756ad1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e546ddd0-81de-42c6-8fbd-6d660af7feba", "tag": "12e1e4c5-4f3a-4faf-9909-3984c992f9b6"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:17.060118 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-8d51da77-2eba-4157-b0b0-e630c43f2ab2 req-cb456f23-7844-4a3c-a52a-632a3756ad1f service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:17.060594 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-8d51da77-2eba-4157-b0b0-e630c43f2ab2 req-cb456f23-7844-4a3c-a52a-632a3756ad1f service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:17.061056 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-8d51da77-2eba-4157-b0b0-e630c43f2ab2 req-cb456f23-7844-4a3c-a52a-632a3756ad1f service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:17.073018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-8d51da77-2eba-4157-b0b0-e630c43f2ab2 req-cb456f23-7844-4a3c-a52a-632a3756ad1f service nova] Creating event network-changed:12e1e4c5-4f3a-4faf-9909-3984c992f9b6 for instance e546ddd0-81de-42c6-8fbd-6d660af7feba on hv-cinder-85221 Sep 06 16:19:17.077989 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-8d51da77-2eba-4157-b0b0-e630c43f2ab2 req-cb456f23-7844-4a3c-a52a-632a3756ad1f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032717 Sep 06 16:19:17.078648 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 269/522] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:19:17.149643 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0441e7d0-a84b-4a2a-850d-80384ef28ff0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:17.150335 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0441e7d0-a84b-4a2a-850d-80384ef28ff0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:17.154704 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c08d48df-e51b-4d79-ac9d-61f519eb10fb tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:17.156892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0441e7d0-a84b-4a2a-850d-80384ef28ff0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:17.157389 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0441e7d0-a84b-4a2a-850d-80384ef28ff0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:17.157815 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0441e7d0-a84b-4a2a-850d-80384ef28ff0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:17.158505 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0441e7d0-a84b-4a2a-850d-80384ef28ff0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:17.158950 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0441e7d0-a84b-4a2a-850d-80384ef28ff0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:17.159364 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0441e7d0-a84b-4a2a-850d-80384ef28ff0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:17.163394 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c08d48df-e51b-4d79-ac9d-61f519eb10fb tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1504 microversion: 2.1 time: 0.210749 Sep 06 16:19:17.164011 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 254/523] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:16 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:17.295159 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0441e7d0-a84b-4a2a-850d-80384ef28ff0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:17.303678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0441e7d0-a84b-4a2a-850d-80384ef28ff0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1511 microversion: 2.1 time: 0.158503 Sep 06 16:19:17.304300 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 270/524] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:17 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:17.721850 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-10cbb49f-17df-4efc-81dc-b8e0136e9e6b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:17.722358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-10cbb49f-17df-4efc-81dc-b8e0136e9e6b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:17.728874 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10cbb49f-17df-4efc-81dc-b8e0136e9e6b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:17.729369 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10cbb49f-17df-4efc-81dc-b8e0136e9e6b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:17.729802 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10cbb49f-17df-4efc-81dc-b8e0136e9e6b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:17.730498 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10cbb49f-17df-4efc-81dc-b8e0136e9e6b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:17.730968 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10cbb49f-17df-4efc-81dc-b8e0136e9e6b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:17.731371 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-10cbb49f-17df-4efc-81dc-b8e0136e9e6b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:17.867822 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-10cbb49f-17df-4efc-81dc-b8e0136e9e6b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:17.879053 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-10cbb49f-17df-4efc-81dc-b8e0136e9e6b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.160498 Sep 06 16:19:17.880026 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 255/525] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:17 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:18.188176 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4a005209-aced-4f95-ba81-8d3b5c60bb8c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:18.188814 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4a005209-aced-4f95-ba81-8d3b5c60bb8c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:18.195319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a005209-aced-4f95-ba81-8d3b5c60bb8c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:18.195808 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a005209-aced-4f95-ba81-8d3b5c60bb8c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:18.196238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a005209-aced-4f95-ba81-8d3b5c60bb8c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:18.196981 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a005209-aced-4f95-ba81-8d3b5c60bb8c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:18.197434 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a005209-aced-4f95-ba81-8d3b5c60bb8c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:18.197855 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a005209-aced-4f95-ba81-8d3b5c60bb8c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:18.327757 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c9827a1f-14d8-4582-9913-a7516952789c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:18.328367 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c9827a1f-14d8-4582-9913-a7516952789c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:18.335399 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9827a1f-14d8-4582-9913-a7516952789c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:18.335888 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9827a1f-14d8-4582-9913-a7516952789c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:18.336315 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9827a1f-14d8-4582-9913-a7516952789c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:18.336961 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4a005209-aced-4f95-ba81-8d3b5c60bb8c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:18.337080 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9827a1f-14d8-4582-9913-a7516952789c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:18.337472 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9827a1f-14d8-4582-9913-a7516952789c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:18.337894 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9827a1f-14d8-4582-9913-a7516952789c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:18.345474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4a005209-aced-4f95-ba81-8d3b5c60bb8c tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1504 microversion: 2.1 time: 0.162496 Sep 06 16:19:18.346054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 271/526] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:18 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:18.476935 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c9827a1f-14d8-4582-9913-a7516952789c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:18.487579 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c9827a1f-14d8-4582-9913-a7516952789c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1511 microversion: 2.1 time: 0.163706 Sep 06 16:19:18.488143 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 256/527] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:18 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:18.904277 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ea622d12-4da8-4d4a-b943-33d62e0b45a3 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:18.904945 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ea622d12-4da8-4d4a-b943-33d62e0b45a3 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:18.911836 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea622d12-4da8-4d4a-b943-33d62e0b45a3 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:18.912328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea622d12-4da8-4d4a-b943-33d62e0b45a3 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:18.912789 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea622d12-4da8-4d4a-b943-33d62e0b45a3 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:18.913494 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea622d12-4da8-4d4a-b943-33d62e0b45a3 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:18.913909 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea622d12-4da8-4d4a-b943-33d62e0b45a3 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:18.914353 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea622d12-4da8-4d4a-b943-33d62e0b45a3 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:18.918716 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:19.052307 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ea622d12-4da8-4d4a-b943-33d62e0b45a3 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:19.060677 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ea622d12-4da8-4d4a-b943-33d62e0b45a3 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.160524 Sep 06 16:19:19.061275 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 272/528] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:18 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:19.369081 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f5a750b6-167b-4a9c-ba9e-4b2a8a62a99b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:19.369821 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f5a750b6-167b-4a9c-ba9e-4b2a8a62a99b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:19.376316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5a750b6-167b-4a9c-ba9e-4b2a8a62a99b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:19.376826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5a750b6-167b-4a9c-ba9e-4b2a8a62a99b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:19.377252 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5a750b6-167b-4a9c-ba9e-4b2a8a62a99b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:19.378064 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5a750b6-167b-4a9c-ba9e-4b2a8a62a99b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:19.378653 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5a750b6-167b-4a9c-ba9e-4b2a8a62a99b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:19.379171 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5a750b6-167b-4a9c-ba9e-4b2a8a62a99b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:19.511070 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-96689884-abab-47fa-9aef-8abb7c687049 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:19.511706 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-96689884-abab-47fa-9aef-8abb7c687049 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:19.518216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96689884-abab-47fa-9aef-8abb7c687049 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:19.518705 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96689884-abab-47fa-9aef-8abb7c687049 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:19.519129 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96689884-abab-47fa-9aef-8abb7c687049 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:19.519234 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f5a750b6-167b-4a9c-ba9e-4b2a8a62a99b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:19.519821 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96689884-abab-47fa-9aef-8abb7c687049 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:19.520270 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96689884-abab-47fa-9aef-8abb7c687049 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:19.520683 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96689884-abab-47fa-9aef-8abb7c687049 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:19.527470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f5a750b6-167b-4a9c-ba9e-4b2a8a62a99b tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1504 microversion: 2.1 time: 0.162315 Sep 06 16:19:19.528054 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 257/529] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:19 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:19.669406 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-96689884-abab-47fa-9aef-8abb7c687049 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:19.678690 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-96689884-abab-47fa-9aef-8abb7c687049 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1511 microversion: 2.1 time: 0.171360 Sep 06 16:19:19.679411 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 273/530] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:19 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:20.085840 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f6c3e121-e1d7-4689-a638-ab9fcb335b51 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:20.086445 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f6c3e121-e1d7-4689-a638-ab9fcb335b51 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:20.097032 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f6c3e121-e1d7-4689-a638-ab9fcb335b51 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:20.098143 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f6c3e121-e1d7-4689-a638-ab9fcb335b51 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:20.098833 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f6c3e121-e1d7-4689-a638-ab9fcb335b51 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:20.100020 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f6c3e121-e1d7-4689-a638-ab9fcb335b51 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:20.100798 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f6c3e121-e1d7-4689-a638-ab9fcb335b51 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:20.101370 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f6c3e121-e1d7-4689-a638-ab9fcb335b51 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:20.243238 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f6c3e121-e1d7-4689-a638-ab9fcb335b51 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:20.251589 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f6c3e121-e1d7-4689-a638-ab9fcb335b51 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.169578 Sep 06 16:19:20.252096 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 258/531] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:20 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:20.551444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4e81be1a-c472-4254-b537-2d57bf874501 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:20.552080 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4e81be1a-c472-4254-b537-2d57bf874501 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:20.558994 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e81be1a-c472-4254-b537-2d57bf874501 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:20.559480 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e81be1a-c472-4254-b537-2d57bf874501 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:20.560266 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e81be1a-c472-4254-b537-2d57bf874501 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:20.561179 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e81be1a-c472-4254-b537-2d57bf874501 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:20.561631 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e81be1a-c472-4254-b537-2d57bf874501 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:20.562049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4e81be1a-c472-4254-b537-2d57bf874501 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:20.702188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-89b59996-bcdb-4509-9537-482978671576 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:20.702827 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-89b59996-bcdb-4509-9537-482978671576 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:20.709908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-89b59996-bcdb-4509-9537-482978671576 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:20.710364 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-89b59996-bcdb-4509-9537-482978671576 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:20.711009 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-89b59996-bcdb-4509-9537-482978671576 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:20.711740 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-89b59996-bcdb-4509-9537-482978671576 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:20.712189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-89b59996-bcdb-4509-9537-482978671576 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:20.712610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-89b59996-bcdb-4509-9537-482978671576 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:20.713357 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4e81be1a-c472-4254-b537-2d57bf874501 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:20.721644 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4e81be1a-c472-4254-b537-2d57bf874501 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1504 microversion: 2.1 time: 0.174104 Sep 06 16:19:20.722229 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 274/532] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:20 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:20.860518 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-89b59996-bcdb-4509-9537-482978671576 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:20.870215 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-89b59996-bcdb-4509-9537-482978671576 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1511 microversion: 2.1 time: 0.171659 Sep 06 16:19:20.870772 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 259/533] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:20 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:21.275805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c8b11e6f-d59c-4e6a-8fdd-33002035355d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:21.278481 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c8b11e6f-d59c-4e6a-8fdd-33002035355d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:21.286915 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c8b11e6f-d59c-4e6a-8fdd-33002035355d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:21.287558 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c8b11e6f-d59c-4e6a-8fdd-33002035355d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:21.287990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c8b11e6f-d59c-4e6a-8fdd-33002035355d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:21.288719 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c8b11e6f-d59c-4e6a-8fdd-33002035355d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:21.289211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c8b11e6f-d59c-4e6a-8fdd-33002035355d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:21.289623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c8b11e6f-d59c-4e6a-8fdd-33002035355d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:21.436023 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c8b11e6f-d59c-4e6a-8fdd-33002035355d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:21.444267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c8b11e6f-d59c-4e6a-8fdd-33002035355d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.173333 Sep 06 16:19:21.445053 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 275/534] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:21 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:21.746680 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-986ff683-a0db-4706-94e2-e39993dfc19f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:21.747260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-986ff683-a0db-4706-94e2-e39993dfc19f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:21.754544 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-986ff683-a0db-4706-94e2-e39993dfc19f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:21.755030 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-986ff683-a0db-4706-94e2-e39993dfc19f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:21.755456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-986ff683-a0db-4706-94e2-e39993dfc19f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:21.756154 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-986ff683-a0db-4706-94e2-e39993dfc19f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:21.756597 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-986ff683-a0db-4706-94e2-e39993dfc19f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:21.757031 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-986ff683-a0db-4706-94e2-e39993dfc19f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:21.894078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1f5abf65-1fcd-430e-9c09-66d077ac109e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:21.894727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1f5abf65-1fcd-430e-9c09-66d077ac109e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:21.896073 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-986ff683-a0db-4706-94e2-e39993dfc19f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:21.902296 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f5abf65-1fcd-430e-9c09-66d077ac109e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:21.902762 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f5abf65-1fcd-430e-9c09-66d077ac109e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:21.903222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f5abf65-1fcd-430e-9c09-66d077ac109e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:21.903911 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f5abf65-1fcd-430e-9c09-66d077ac109e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:21.904323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f5abf65-1fcd-430e-9c09-66d077ac109e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:21.904800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f5abf65-1fcd-430e-9c09-66d077ac109e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:21.905261 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-986ff683-a0db-4706-94e2-e39993dfc19f tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1504 microversion: 2.1 time: 0.163796 Sep 06 16:19:21.905856 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 260/535] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:21 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:22.055252 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1f5abf65-1fcd-430e-9c09-66d077ac109e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:22.064595 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1f5abf65-1fcd-430e-9c09-66d077ac109e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1511 microversion: 2.1 time: 0.174345 Sep 06 16:19:22.065192 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 276/536] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:21 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:22.468266 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d8da096b-d375-4ea6-b627-8373bd06bae5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:22.468978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d8da096b-d375-4ea6-b627-8373bd06bae5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:22.478320 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8da096b-d375-4ea6-b627-8373bd06bae5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:22.478809 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8da096b-d375-4ea6-b627-8373bd06bae5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:22.479198 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8da096b-d375-4ea6-b627-8373bd06bae5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:22.479907 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8da096b-d375-4ea6-b627-8373bd06bae5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:22.480359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8da096b-d375-4ea6-b627-8373bd06bae5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:22.480789 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8da096b-d375-4ea6-b627-8373bd06bae5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:22.629879 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d8da096b-d375-4ea6-b627-8373bd06bae5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:22.638069 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d8da096b-d375-4ea6-b627-8373bd06bae5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.173820 Sep 06 16:19:22.638644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 261/537] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:22 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:22.928538 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2c1e0736-8411-4e18-889f-30208c9d8bcf tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:22.929144 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2c1e0736-8411-4e18-889f-30208c9d8bcf tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:22.936120 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2c1e0736-8411-4e18-889f-30208c9d8bcf tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:22.936598 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2c1e0736-8411-4e18-889f-30208c9d8bcf tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:22.937067 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2c1e0736-8411-4e18-889f-30208c9d8bcf tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:22.937760 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2c1e0736-8411-4e18-889f-30208c9d8bcf tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:22.938210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2c1e0736-8411-4e18-889f-30208c9d8bcf tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:22.938626 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2c1e0736-8411-4e18-889f-30208c9d8bcf tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:23.073475 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2c1e0736-8411-4e18-889f-30208c9d8bcf tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:23.081396 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2c1e0736-8411-4e18-889f-30208c9d8bcf tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1504 microversion: 2.1 time: 0.156937 Sep 06 16:19:23.081972 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 277/538] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:22 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:23.102956 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-24762074-0fe4-4a7f-a4f4-5830faffd9d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:23.103595 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-24762074-0fe4-4a7f-a4f4-5830faffd9d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:23.112583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24762074-0fe4-4a7f-a4f4-5830faffd9d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:23.113113 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24762074-0fe4-4a7f-a4f4-5830faffd9d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:23.113550 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24762074-0fe4-4a7f-a4f4-5830faffd9d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:23.114255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24762074-0fe4-4a7f-a4f4-5830faffd9d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:23.114706 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24762074-0fe4-4a7f-a4f4-5830faffd9d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:23.115127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24762074-0fe4-4a7f-a4f4-5830faffd9d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:23.257514 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-24762074-0fe4-4a7f-a4f4-5830faffd9d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:23.265801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-24762074-0fe4-4a7f-a4f4-5830faffd9d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1511 microversion: 2.1 time: 0.166995 Sep 06 16:19:23.266375 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 262/539] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:23 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:23.660340 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a7aca2af-ab8a-47ba-88e9-48048ad388da tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:23.660995 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a7aca2af-ab8a-47ba-88e9-48048ad388da tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:23.667609 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7aca2af-ab8a-47ba-88e9-48048ad388da tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:23.668179 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7aca2af-ab8a-47ba-88e9-48048ad388da tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:23.668597 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7aca2af-ab8a-47ba-88e9-48048ad388da tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:23.669313 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7aca2af-ab8a-47ba-88e9-48048ad388da tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:23.669842 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7aca2af-ab8a-47ba-88e9-48048ad388da tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:23.670260 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7aca2af-ab8a-47ba-88e9-48048ad388da tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:23.822191 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a7aca2af-ab8a-47ba-88e9-48048ad388da tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:23.830312 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a7aca2af-ab8a-47ba-88e9-48048ad388da tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.173852 Sep 06 16:19:23.830888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 278/540] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:23 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:24.109380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4949beb5-df29-48bf-8aec-a64d60a6f97a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:24.110370 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4949beb5-df29-48bf-8aec-a64d60a6f97a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:24.121288 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4949beb5-df29-48bf-8aec-a64d60a6f97a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:24.122115 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4949beb5-df29-48bf-8aec-a64d60a6f97a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:24.122794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4949beb5-df29-48bf-8aec-a64d60a6f97a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:24.123928 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4949beb5-df29-48bf-8aec-a64d60a6f97a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:24.124707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4949beb5-df29-48bf-8aec-a64d60a6f97a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:24.125445 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4949beb5-df29-48bf-8aec-a64d60a6f97a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:24.275521 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4949beb5-df29-48bf-8aec-a64d60a6f97a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:24.288091 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4949beb5-df29-48bf-8aec-a64d60a6f97a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1504 microversion: 2.1 time: 0.185808 Sep 06 16:19:24.288690 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 263/541] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:24 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:24.289340 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3963a6e6-eb0e-4a8b-ae8f-c81f210b66a5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:24.289939 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3963a6e6-eb0e-4a8b-ae8f-c81f210b66a5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:24.296083 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3963a6e6-eb0e-4a8b-ae8f-c81f210b66a5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:24.296800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3963a6e6-eb0e-4a8b-ae8f-c81f210b66a5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:24.297420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3963a6e6-eb0e-4a8b-ae8f-c81f210b66a5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:24.298108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3963a6e6-eb0e-4a8b-ae8f-c81f210b66a5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:24.298551 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3963a6e6-eb0e-4a8b-ae8f-c81f210b66a5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:24.298966 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3963a6e6-eb0e-4a8b-ae8f-c81f210b66a5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:24.459020 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3963a6e6-eb0e-4a8b-ae8f-c81f210b66a5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:24.467404 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3963a6e6-eb0e-4a8b-ae8f-c81f210b66a5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1511 microversion: 2.1 time: 0.181962 Sep 06 16:19:24.467993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 279/542] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:24 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:24.855832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ba5ad715-276d-4245-a520-a5cb4ba1e6e5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:24.856456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ba5ad715-276d-4245-a520-a5cb4ba1e6e5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:24.870608 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba5ad715-276d-4245-a520-a5cb4ba1e6e5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:24.871092 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba5ad715-276d-4245-a520-a5cb4ba1e6e5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:24.871518 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba5ad715-276d-4245-a520-a5cb4ba1e6e5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:24.872428 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba5ad715-276d-4245-a520-a5cb4ba1e6e5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:24.872895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba5ad715-276d-4245-a520-a5cb4ba1e6e5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:24.873324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba5ad715-276d-4245-a520-a5cb4ba1e6e5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:25.021405 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ba5ad715-276d-4245-a520-a5cb4ba1e6e5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:25.029703 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ba5ad715-276d-4245-a520-a5cb4ba1e6e5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.180064 Sep 06 16:19:25.030306 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 264/543] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:24 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:25.312270 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-227c5757-b434-4f42-a4ad-0ee91d08f1f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:25.312970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-227c5757-b434-4f42-a4ad-0ee91d08f1f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:25.321510 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-227c5757-b434-4f42-a4ad-0ee91d08f1f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:25.321510 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-227c5757-b434-4f42-a4ad-0ee91d08f1f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:25.321510 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-227c5757-b434-4f42-a4ad-0ee91d08f1f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:25.321905 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-227c5757-b434-4f42-a4ad-0ee91d08f1f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:25.321999 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-227c5757-b434-4f42-a4ad-0ee91d08f1f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:25.322410 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-227c5757-b434-4f42-a4ad-0ee91d08f1f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:25.467798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-227c5757-b434-4f42-a4ad-0ee91d08f1f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:25.477360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-227c5757-b434-4f42-a4ad-0ee91d08f1f7 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1504 microversion: 2.1 time: 0.169460 Sep 06 16:19:25.478001 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 280/544] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:25 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:25.490860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cd7a409c-79dc-4c28-b367-a9d3d40e482b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:25.491452 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cd7a409c-79dc-4c28-b367-a9d3d40e482b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:25.498217 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd7a409c-79dc-4c28-b367-a9d3d40e482b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:25.498701 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd7a409c-79dc-4c28-b367-a9d3d40e482b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:25.499138 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd7a409c-79dc-4c28-b367-a9d3d40e482b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:25.499838 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd7a409c-79dc-4c28-b367-a9d3d40e482b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:25.500283 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd7a409c-79dc-4c28-b367-a9d3d40e482b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:25.500708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd7a409c-79dc-4c28-b367-a9d3d40e482b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:25.641223 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cd7a409c-79dc-4c28-b367-a9d3d40e482b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:25.652385 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cd7a409c-79dc-4c28-b367-a9d3d40e482b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1517 microversion: 2.1 time: 0.165443 Sep 06 16:19:25.652994 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 265/545] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:25 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:26.057640 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c39e85d4-d99f-4413-b857-8fb01771e37d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:26.059828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c39e85d4-d99f-4413-b857-8fb01771e37d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:26.068253 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c39e85d4-d99f-4413-b857-8fb01771e37d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:26.068993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c39e85d4-d99f-4413-b857-8fb01771e37d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:26.069588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c39e85d4-d99f-4413-b857-8fb01771e37d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:26.070291 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c39e85d4-d99f-4413-b857-8fb01771e37d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:26.070746 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c39e85d4-d99f-4413-b857-8fb01771e37d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:26.071164 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c39e85d4-d99f-4413-b857-8fb01771e37d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:26.241747 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c39e85d4-d99f-4413-b857-8fb01771e37d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:26.253467 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c39e85d4-d99f-4413-b857-8fb01771e37d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.200161 Sep 06 16:19:26.254661 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 281/546] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:26 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:26.479657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-5f21d1fc-abc0-4d75-b588-755cd64d1011 req-7f7714de-03c9-41ea-afc8-81892e3eec71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de5cf7ef-d435-4db6-a52b-91466bef6028", "name": "network-vif-deleted", "tag": "a0899bf2-7bef-4c09-b31b-ce93cf08d785"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:26.493654 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5f21d1fc-abc0-4d75-b588-755cd64d1011 req-7f7714de-03c9-41ea-afc8-81892e3eec71 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:26.494320 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5f21d1fc-abc0-4d75-b588-755cd64d1011 req-7f7714de-03c9-41ea-afc8-81892e3eec71 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:26.494979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5f21d1fc-abc0-4d75-b588-755cd64d1011 req-7f7714de-03c9-41ea-afc8-81892e3eec71 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:26.501131 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-62aff88f-c228-4f49-8689-b65dc2f7a8d3 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:26.502566 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-62aff88f-c228-4f49-8689-b65dc2f7a8d3 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:26.503992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:26.513473 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62aff88f-c228-4f49-8689-b65dc2f7a8d3 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:26.514417 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62aff88f-c228-4f49-8689-b65dc2f7a8d3 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:26.515230 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62aff88f-c228-4f49-8689-b65dc2f7a8d3 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:26.516187 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62aff88f-c228-4f49-8689-b65dc2f7a8d3 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:26.516873 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62aff88f-c228-4f49-8689-b65dc2f7a8d3 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:26.517550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62aff88f-c228-4f49-8689-b65dc2f7a8d3 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:26.523250 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-5f21d1fc-abc0-4d75-b588-755cd64d1011 req-7f7714de-03c9-41ea-afc8-81892e3eec71 service nova] Creating event network-vif-deleted:a0899bf2-7bef-4c09-b31b-ce93cf08d785 for instance de5cf7ef-d435-4db6-a52b-91466bef6028 on hv-cinder-85221 Sep 06 16:19:26.532633 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-5f21d1fc-abc0-4d75-b588-755cd64d1011 req-7f7714de-03c9-41ea-afc8-81892e3eec71 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065531 Sep 06 16:19:26.533826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 266/547] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:19:26.587239 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-62aff88f-c228-4f49-8689-b65dc2f7a8d3 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2921386cc370487da26a786c8198c94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dcd76a5f24bd7ba164032cbe22d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:26.596164 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-62aff88f-c228-4f49-8689-b65dc2f7a8d3 tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 200 len: 1462 microversion: 2.1 time: 0.099111 Sep 06 16:19:26.596739 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 282/548] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:26 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 1462 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:27.093562 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-26a06211-1d66-43e3-9122-7e9da27c0bc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Action: 'create', calling method: .version_select at 0x7f83e95864c0>, body: {"keypair": {"name": "tempest-keypair-2069068681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7Eu4les2vQtqzCTmsIrMDBsMe3vJXCf15hkDYY3mdhvqWAhzsMywHpo2a6xsM8OLEDeBEQ5UjJWaeCt5rqRF/XS7LQy/3ToGLP3ps7IQ6iSs1KnYDcZ4dxQXUsaTCiqA=="}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:27.110805 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-26a06211-1d66-43e3-9122-7e9da27c0bc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Getting quotas for project 49a3e0cfba224a119bf8aaf26ae583f4. Resources: {'key_pairs'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:19:27.115392 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-26a06211-1d66-43e3-9122-7e9da27c0bc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Getting quotas for user 93096a58fcb34f2085a05ffa40df5937 and project 49a3e0cfba224a119bf8aaf26ae583f4. Resources: {'key_pairs'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:19:27.143875 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-26a06211-1d66-43e3-9122-7e9da27c0bc6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054486 Sep 06 16:19:27.144933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 267/549] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 6 16:19:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:19:27.284370 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6e5451ab-50f2-441b-bcef-f681a19bd551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:27.285075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6e5451ab-50f2-441b-bcef-f681a19bd551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:27.292186 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6e5451ab-50f2-441b-bcef-f681a19bd551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:27.293011 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6e5451ab-50f2-441b-bcef-f681a19bd551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:27.293633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6e5451ab-50f2-441b-bcef-f681a19bd551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:27.294368 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6e5451ab-50f2-441b-bcef-f681a19bd551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:27.294856 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6e5451ab-50f2-441b-bcef-f681a19bd551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:27.295539 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6e5451ab-50f2-441b-bcef-f681a19bd551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:27.567089 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6e5451ab-50f2-441b-bcef-f681a19bd551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:27.592930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6e5451ab-50f2-441b-bcef-f681a19bd551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.313048 Sep 06 16:19:27.594102 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 283/550] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:27 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:27.622551 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d2235dcc-08f7-41a3-89a0-2e93da7d001a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:27.623285 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d2235dcc-08f7-41a3-89a0-2e93da7d001a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] [instance: de5cf7ef-d435-4db6-a52b-91466bef6028] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:27.632859 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d2235dcc-08f7-41a3-89a0-2e93da7d001a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:27.633354 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d2235dcc-08f7-41a3-89a0-2e93da7d001a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:27.633786 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d2235dcc-08f7-41a3-89a0-2e93da7d001a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:27.634499 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d2235dcc-08f7-41a3-89a0-2e93da7d001a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:27.634944 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d2235dcc-08f7-41a3-89a0-2e93da7d001a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:27.635625 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d2235dcc-08f7-41a3-89a0-2e93da7d001a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:27.665878 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-d2235dcc-08f7-41a3-89a0-2e93da7d001a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] HTTP exception thrown: Instance de5cf7ef-d435-4db6-a52b-91466bef6028 could not be found. Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d2235dcc-08f7-41a3-89a0-2e93da7d001a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Request method failure captured: Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 HTTP/1.1 Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3KxNiM1HupUP7RsC4gq4C0LBnS5IDy-S1nhwceRoTNwg1vnleD6YjegryfDqedg8IPJ4ZOZoznaSEGu3y5WFjkRnpzzciihVCcZOn7PXeqclIwC_9sItKewokj3aGQjlOmI7t5MC45ygDGVkclEGN4bO7tC19X9npvuf07coG9Pwhs Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 4a2dcd76a5f24bd7ba164032cbe22d20 Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesActionsTest-961304812 Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:19:27.667566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:19:27.669044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a2dcd76a5f24bd7ba164032cbe22d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4a2dcd76a5f24bd7ba164032cbe22d20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4a2dcd76a5f24bd7ba164032cbe22d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4a2dcd76a5f24bd7ba164032cbe22d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:19:27.669044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesActionsTest-961304812 Sep 06 16:19:27.669044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 4a2dcd76a5f24bd7ba164032cbe22d20 Sep 06 16:19:27.669044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesActionsTest-961304812 Sep 06 16:19:27.669044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesActionsTest-961304812-project Sep 06 16:19:27.669044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:19:27.669044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:19:27.669044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 2921386cc370487da26a786c8198c94c Sep 06 16:19:27.669044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesActionsTest-961304812-project Sep 06 16:19:27.669044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:19:27.669044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance de5cf7ef-d435-4db6-a52b-91466bef6028 could not be found. Sep 06 16:19:27.669044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'de5cf7ef-d435-4db6-a52b-91466bef6028'} Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de5cf7ef-d435-4db6-a52b-91466bef6028 could not be found. Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:19:27.669882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de5cf7ef-d435-4db6-a52b-91466bef6028 could not be found. Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de5cf7ef-d435-4db6-a52b-91466bef6028 could not be found. Sep 06 16:19:27.671012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:19:27.673488 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d2235dcc-08f7-41a3-89a0-2e93da7d001a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] Returning 404 to user: Instance de5cf7ef-d435-4db6-a52b-91466bef6028 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:19:27.674432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d2235dcc-08f7-41a3-89a0-2e93da7d001a tempest-VolumesActionsTest-961304812 tempest-VolumesActionsTest-961304812-project] 10.222.0.43 "GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028" status: 404 len: 111 microversion: 2.1 time: 0.056415 Sep 06 16:19:27.675006 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 268/551] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:27 2022] GET /compute/v2.1/servers/de5cf7ef-d435-4db6-a52b-91466bef6028 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:19:27.769837 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c6584efe-3bd8-4196-b345-bca5c5d82694 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:27.770828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c6584efe-3bd8-4196-b345-bca5c5d82694 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:27.787516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c6584efe-3bd8-4196-b345-bca5c5d82694 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:27.789863 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c6584efe-3bd8-4196-b345-bca5c5d82694 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:27.790579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c6584efe-3bd8-4196-b345-bca5c5d82694 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:27.791789 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c6584efe-3bd8-4196-b345-bca5c5d82694 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:27.792682 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c6584efe-3bd8-4196-b345-bca5c5d82694 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:27.793808 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c6584efe-3bd8-4196-b345-bca5c5d82694 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:28.054386 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c6584efe-3bd8-4196-b345-bca5c5d82694 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:28.063888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c6584efe-3bd8-4196-b345-bca5c5d82694 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1594 microversion: 2.1 time: 0.297862 Sep 06 16:19:28.064812 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 284/552] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:27 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1594 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:28.620125 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b4c375b1-2c3d-4c5b-9e80-b93d92b508bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:28.622163 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b4c375b1-2c3d-4c5b-9e80-b93d92b508bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:28.625708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:28.637297 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b4c375b1-2c3d-4c5b-9e80-b93d92b508bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:28.638154 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b4c375b1-2c3d-4c5b-9e80-b93d92b508bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:28.638674 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b4c375b1-2c3d-4c5b-9e80-b93d92b508bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:28.639662 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b4c375b1-2c3d-4c5b-9e80-b93d92b508bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:28.640339 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b4c375b1-2c3d-4c5b-9e80-b93d92b508bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:28.640851 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b4c375b1-2c3d-4c5b-9e80-b93d92b508bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:28.779977 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b4c375b1-2c3d-4c5b-9e80-b93d92b508bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:28.787884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b4c375b1-2c3d-4c5b-9e80-b93d92b508bd tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.172859 Sep 06 16:19:28.788462 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 269/553] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:28 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:29.391921 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1154284056", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f9940ad-7a47-4053-bec0-907c40de1d34"}], "security_groups": [{"name": "tempest-securitygroup--775567963"}], "key_name": "tempest-keypair-2069068681", "user_data": "}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:29.399922 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b99fd240-5b49-468d-b2a2-c09ee731163f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:29.400609 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b99fd240-5b49-468d-b2a2-c09ee731163f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:29.408107 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b99fd240-5b49-468d-b2a2-c09ee731163f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:29.408598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b99fd240-5b49-468d-b2a2-c09ee731163f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:29.409147 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b99fd240-5b49-468d-b2a2-c09ee731163f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:29.410037 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b99fd240-5b49-468d-b2a2-c09ee731163f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:29.410513 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b99fd240-5b49-468d-b2a2-c09ee731163f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:29.411239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b99fd240-5b49-468d-b2a2-c09ee731163f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:29.439012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b99fd240-5b49-468d-b2a2-c09ee731163f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/ips" status: 200 len: 151 microversion: 2.20 time: 0.042888 Sep 06 16:19:29.439833 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 270/554] 10.222.0.43 () {60 vars in 1289 bytes} [Tue Sep 6 16:19:29 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 16:19:29.814713 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-bc3f7cc6-8493-4dfb-abd6-4a4381c6eaa2 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:29.815686 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-bc3f7cc6-8493-4dfb-abd6-4a4381c6eaa2 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:29.823089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc3f7cc6-8493-4dfb-abd6-4a4381c6eaa2 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:29.823933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc3f7cc6-8493-4dfb-abd6-4a4381c6eaa2 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:29.824598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc3f7cc6-8493-4dfb-abd6-4a4381c6eaa2 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:29.825527 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc3f7cc6-8493-4dfb-abd6-4a4381c6eaa2 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:29.826358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc3f7cc6-8493-4dfb-abd6-4a4381c6eaa2 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:29.826982 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc3f7cc6-8493-4dfb-abd6-4a4381c6eaa2 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:29.872249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.network.neutron [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] validate_networks() for [('2f9940ad-7a47-4053-bec0-907c40de1d34', None, None, None, None, None)] {{(pid=120668) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:19:29.968735 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-bc3f7cc6-8493-4dfb-abd6-4a4381c6eaa2 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:29.976585 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-bc3f7cc6-8493-4dfb-abd6-4a4381c6eaa2 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.167482 Sep 06 16:19:29.977194 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 271/555] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:29 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:30.620146 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Flavor limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:19:30.620647 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Image limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:19:30.621186 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Flavor pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:19:30.621658 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Image pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:19:30.622122 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:19:30.640954 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:30.641492 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:30.641942 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:30.642683 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:30.643247 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:30.643800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:30.661733 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Getting quotas for project 49a3e0cfba224a119bf8aaf26ae583f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:19:30.666148 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Getting quotas for user 93096a58fcb34f2085a05ffa40df5937 and project 49a3e0cfba224a119bf8aaf26ae583f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:19:30.678501 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Going to run 1 instances... {{(pid=120668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:19:30.681379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:19:30.729960 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-bb12fb11-84c4-4670-b173-6ed662cbf0ac tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.342243 Sep 06 16:19:30.736889 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 285/556] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:19:29 2022] POST /compute/v2.1/servers => generated 408 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:19:30.742088 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-76bca2ee-b1ed-4ae8-be60-7675623ab696 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:30.742829 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-76bca2ee-b1ed-4ae8-be60-7675623ab696 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:30.798547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-76bca2ee-b1ed-4ae8-be60-7675623ab696 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:30.807494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-76bca2ee-b1ed-4ae8-be60-7675623ab696 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1246 microversion: 2.1 time: 0.068740 Sep 06 16:19:30.808346 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 272/557] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:30 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:31.000291 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a2ac5260-1cf4-4508-85e8-0ebf7a81248b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:31.000934 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a2ac5260-1cf4-4508-85e8-0ebf7a81248b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:31.009462 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a2ac5260-1cf4-4508-85e8-0ebf7a81248b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:31.009919 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a2ac5260-1cf4-4508-85e8-0ebf7a81248b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:31.010515 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a2ac5260-1cf4-4508-85e8-0ebf7a81248b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:31.011216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a2ac5260-1cf4-4508-85e8-0ebf7a81248b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:31.011651 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a2ac5260-1cf4-4508-85e8-0ebf7a81248b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:31.012084 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a2ac5260-1cf4-4508-85e8-0ebf7a81248b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:31.140820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-ffea7f61-d4a4-4527-b979-babc729ef69a req-bc3accb3-4ce0-4aa0-b596-15cf4fcc94da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3078c7e6-28cd-4a26-ba9e-5920ccc1f46a", "tag": "c0116dca-9ccf-4f2c-b879-4db2cc4f54a3"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:31.152054 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-ffea7f61-d4a4-4527-b979-babc729ef69a req-bc3accb3-4ce0-4aa0-b596-15cf4fcc94da service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:31.152995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-ffea7f61-d4a4-4527-b979-babc729ef69a req-bc3accb3-4ce0-4aa0-b596-15cf4fcc94da service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:31.153427 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-ffea7f61-d4a4-4527-b979-babc729ef69a req-bc3accb3-4ce0-4aa0-b596-15cf4fcc94da service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:31.175050 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-ffea7f61-d4a4-4527-b979-babc729ef69a req-bc3accb3-4ce0-4aa0-b596-15cf4fcc94da service nova] Creating event network-changed:c0116dca-9ccf-4f2c-b879-4db2cc4f54a3 for instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a on hv-cinder-85221 Sep 06 16:19:31.182282 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-ffea7f61-d4a4-4527-b979-babc729ef69a req-bc3accb3-4ce0-4aa0-b596-15cf4fcc94da service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044255 Sep 06 16:19:31.183583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 273/558] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:19:31.260443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a2ac5260-1cf4-4508-85e8-0ebf7a81248b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:31.270945 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a2ac5260-1cf4-4508-85e8-0ebf7a81248b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.274644 Sep 06 16:19:31.272376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 286/559] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:30 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:31.831866 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-82302ebb-0463-410f-870d-8b26105a56a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:31.832770 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-82302ebb-0463-410f-870d-8b26105a56a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:31.839151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82302ebb-0463-410f-870d-8b26105a56a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:31.839641 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82302ebb-0463-410f-870d-8b26105a56a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:31.840071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82302ebb-0463-410f-870d-8b26105a56a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:31.840792 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82302ebb-0463-410f-870d-8b26105a56a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:31.841238 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82302ebb-0463-410f-870d-8b26105a56a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:31.841660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82302ebb-0463-410f-870d-8b26105a56a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:31.917799 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-82302ebb-0463-410f-870d-8b26105a56a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:31.926225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-82302ebb-0463-410f-870d-8b26105a56a3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1250 microversion: 2.1 time: 0.098858 Sep 06 16:19:31.927720 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 274/560] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:31 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1250 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:32.250456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4217d913-240e-40a1-890d-726634a414a0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-514035415"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:32.251193 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4217d913-240e-40a1-890d-726634a414a0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:32.258560 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4217d913-240e-40a1-890d-726634a414a0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:32.259038 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4217d913-240e-40a1-890d-726634a414a0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:32.259457 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4217d913-240e-40a1-890d-726634a414a0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:32.260148 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4217d913-240e-40a1-890d-726634a414a0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:32.260592 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4217d913-240e-40a1-890d-726634a414a0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:32.261027 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4217d913-240e-40a1-890d-726634a414a0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:32.295718 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a1b9d7db-09b5-4621-bec5-e3ac51584196 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:32.296487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a1b9d7db-09b5-4621-bec5-e3ac51584196 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:32.304162 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a1b9d7db-09b5-4621-bec5-e3ac51584196 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:32.304655 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a1b9d7db-09b5-4621-bec5-e3ac51584196 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:32.305151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a1b9d7db-09b5-4621-bec5-e3ac51584196 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:32.305832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a1b9d7db-09b5-4621-bec5-e3ac51584196 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:32.306281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a1b9d7db-09b5-4621-bec5-e3ac51584196 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:32.306866 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a1b9d7db-09b5-4621-bec5-e3ac51584196 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:32.417803 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.network.security_group_api [None req-4217d913-240e-40a1-890d-726634a414a0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Adding security group 7b70e853-c2dd-49d0-b2b7-e1cdbdf5dfb5 to port c0116dca-9ccf-4f2c-b879-4db2cc4f54a3 Sep 06 16:19:32.452358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a1b9d7db-09b5-4621-bec5-e3ac51584196 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:32.465095 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a1b9d7db-09b5-4621-bec5-e3ac51584196 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.173268 Sep 06 16:19:32.480784 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 275/561] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:32 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:32.793567 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4217d913-240e-40a1-890d-726634a414a0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "POST /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/action" status: 202 len: 0 microversion: 2.1 time: 0.548975 Sep 06 16:19:32.794189 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 287/562] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:19:32 2022] POST /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:19:32.803133 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-58185fc9-549f-456a-b912-d78edaa535b4 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:32.804084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-58185fc9-549f-456a-b912-d78edaa535b4 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:32.811045 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-58185fc9-549f-456a-b912-d78edaa535b4 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:32.811532 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-58185fc9-549f-456a-b912-d78edaa535b4 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:32.811964 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-58185fc9-549f-456a-b912-d78edaa535b4 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:32.812955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-58185fc9-549f-456a-b912-d78edaa535b4 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:32.813796 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-58185fc9-549f-456a-b912-d78edaa535b4 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:32.815916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-58185fc9-549f-456a-b912-d78edaa535b4 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:32.950554 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-62602740-8a58-4300-9e99-426d22530ab6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:32.951513 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-62602740-8a58-4300-9e99-426d22530ab6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:32.958717 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62602740-8a58-4300-9e99-426d22530ab6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:32.959212 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62602740-8a58-4300-9e99-426d22530ab6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:32.959638 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62602740-8a58-4300-9e99-426d22530ab6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:32.960339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62602740-8a58-4300-9e99-426d22530ab6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:32.960831 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62602740-8a58-4300-9e99-426d22530ab6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:32.961288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-62602740-8a58-4300-9e99-426d22530ab6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:32.976934 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-58185fc9-549f-456a-b912-d78edaa535b4 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:32.986711 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-58185fc9-549f-456a-b912-d78edaa535b4 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1640 microversion: 2.1 time: 0.187425 Sep 06 16:19:32.987179 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 276/563] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:32 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1640 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:33.031728 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-62602740-8a58-4300-9e99-426d22530ab6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:33.039635 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-62602740-8a58-4300-9e99-426d22530ab6 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1250 microversion: 2.1 time: 0.092973 Sep 06 16:19:33.040204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 288/564] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:32 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1250 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:33.208077 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-c9082260-1c22-4d1f-8268-f7ba987b99b7 req-4bfb7482-85a2-4fca-a202-51d5fb9d7042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3078c7e6-28cd-4a26-ba9e-5920ccc1f46a", "tag": "c0116dca-9ccf-4f2c-b879-4db2cc4f54a3"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:33.222937 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-c9082260-1c22-4d1f-8268-f7ba987b99b7 req-4bfb7482-85a2-4fca-a202-51d5fb9d7042 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:33.223409 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-c9082260-1c22-4d1f-8268-f7ba987b99b7 req-4bfb7482-85a2-4fca-a202-51d5fb9d7042 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:33.223836 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-c9082260-1c22-4d1f-8268-f7ba987b99b7 req-4bfb7482-85a2-4fca-a202-51d5fb9d7042 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:33.235896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-c9082260-1c22-4d1f-8268-f7ba987b99b7 req-4bfb7482-85a2-4fca-a202-51d5fb9d7042 service nova] Creating event network-changed:c0116dca-9ccf-4f2c-b879-4db2cc4f54a3 for instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a on hv-cinder-85221 Sep 06 16:19:33.241225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-c9082260-1c22-4d1f-8268-f7ba987b99b7 req-4bfb7482-85a2-4fca-a202-51d5fb9d7042 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039090 Sep 06 16:19:33.241756 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 277/565] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:19:33.489861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-28b221ea-97d9-4783-b5c3-3e9477446024 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:33.490437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-28b221ea-97d9-4783-b5c3-3e9477446024 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:33.497048 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-28b221ea-97d9-4783-b5c3-3e9477446024 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:33.497453 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-28b221ea-97d9-4783-b5c3-3e9477446024 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:33.497880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-28b221ea-97d9-4783-b5c3-3e9477446024 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:33.498579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-28b221ea-97d9-4783-b5c3-3e9477446024 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:33.499058 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-28b221ea-97d9-4783-b5c3-3e9477446024 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:33.499474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-28b221ea-97d9-4783-b5c3-3e9477446024 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:33.640715 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-28b221ea-97d9-4783-b5c3-3e9477446024 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:33.645304 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:33.651122 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-28b221ea-97d9-4783-b5c3-3e9477446024 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.165380 Sep 06 16:19:33.651713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 289/566] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:33 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:34.066513 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4ce36a53-1107-44aa-813f-597319407ab8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:34.067231 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4ce36a53-1107-44aa-813f-597319407ab8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:34.073900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ce36a53-1107-44aa-813f-597319407ab8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:34.074514 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ce36a53-1107-44aa-813f-597319407ab8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:34.075027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ce36a53-1107-44aa-813f-597319407ab8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:34.076186 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ce36a53-1107-44aa-813f-597319407ab8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:34.076937 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ce36a53-1107-44aa-813f-597319407ab8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:34.077582 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ce36a53-1107-44aa-813f-597319407ab8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:34.150254 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4ce36a53-1107-44aa-813f-597319407ab8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:34.158667 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4ce36a53-1107-44aa-813f-597319407ab8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1250 microversion: 2.1 time: 0.096897 Sep 06 16:19:34.159279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 278/567] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:34 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1250 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:34.676177 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c3e9019b-4cd6-4554-aa1a-3790c5aa1754 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:34.677528 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c3e9019b-4cd6-4554-aa1a-3790c5aa1754 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:34.685481 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c3e9019b-4cd6-4554-aa1a-3790c5aa1754 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:34.686022 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c3e9019b-4cd6-4554-aa1a-3790c5aa1754 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:34.686465 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c3e9019b-4cd6-4554-aa1a-3790c5aa1754 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:34.687177 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c3e9019b-4cd6-4554-aa1a-3790c5aa1754 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:34.687639 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c3e9019b-4cd6-4554-aa1a-3790c5aa1754 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:34.688055 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c3e9019b-4cd6-4554-aa1a-3790c5aa1754 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:34.833908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c3e9019b-4cd6-4554-aa1a-3790c5aa1754 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:34.845551 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c3e9019b-4cd6-4554-aa1a-3790c5aa1754 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.173522 Sep 06 16:19:34.845979 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 290/568] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:34 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:35.185617 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-61623a98-2e90-4159-b86a-7fa9be22b63c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:35.187041 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-61623a98-2e90-4159-b86a-7fa9be22b63c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:35.202008 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-61623a98-2e90-4159-b86a-7fa9be22b63c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:35.202826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-61623a98-2e90-4159-b86a-7fa9be22b63c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:35.204635 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-61623a98-2e90-4159-b86a-7fa9be22b63c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:35.208904 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-61623a98-2e90-4159-b86a-7fa9be22b63c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:35.210851 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-61623a98-2e90-4159-b86a-7fa9be22b63c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:35.211483 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-61623a98-2e90-4159-b86a-7fa9be22b63c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:35.346383 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-61623a98-2e90-4159-b86a-7fa9be22b63c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:35.354857 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-61623a98-2e90-4159-b86a-7fa9be22b63c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1298 microversion: 2.1 time: 0.174173 Sep 06 16:19:35.360161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 279/569] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:35 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:35.687809 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7d6720b9-3e09-418e-ace2-8035187d2d86 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:35.689171 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7d6720b9-3e09-418e-ace2-8035187d2d86 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:35.700446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d6720b9-3e09-418e-ace2-8035187d2d86 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:35.707082 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d6720b9-3e09-418e-ace2-8035187d2d86 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:35.707856 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d6720b9-3e09-418e-ace2-8035187d2d86 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:35.708690 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d6720b9-3e09-418e-ace2-8035187d2d86 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:35.709379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d6720b9-3e09-418e-ace2-8035187d2d86 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:35.709875 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d6720b9-3e09-418e-ace2-8035187d2d86 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:35.737617 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-7d6720b9-3e09-418e-ace2-8035187d2d86 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lazy-loading 'flavor' on Instance uuid b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:19:35.867809 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f929f80d-9465-471e-af22-0b74c0d25ea1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:35.868890 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f929f80d-9465-471e-af22-0b74c0d25ea1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:35.881464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f929f80d-9465-471e-af22-0b74c0d25ea1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:35.882108 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f929f80d-9465-471e-af22-0b74c0d25ea1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:35.882677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f929f80d-9465-471e-af22-0b74c0d25ea1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:35.883511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f929f80d-9465-471e-af22-0b74c0d25ea1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:35.884103 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f929f80d-9465-471e-af22-0b74c0d25ea1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:35.884642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f929f80d-9465-471e-af22-0b74c0d25ea1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:36.010426 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7d6720b9-3e09-418e-ace2-8035187d2d86 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "POST /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/action" status: 202 len: 0 microversion: 2.20 time: 0.327105 Sep 06 16:19:36.011552 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 291/570] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Sep 6 16:19:35 2022] POST /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:19:36.042417 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9a980f65-37c7-4fe3-be23-733bdeedef04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:36.046554 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9a980f65-37c7-4fe3-be23-733bdeedef04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:36.062279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9a980f65-37c7-4fe3-be23-733bdeedef04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:36.067795 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9a980f65-37c7-4fe3-be23-733bdeedef04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:36.068526 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9a980f65-37c7-4fe3-be23-733bdeedef04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:36.069545 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9a980f65-37c7-4fe3-be23-733bdeedef04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:36.070159 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9a980f65-37c7-4fe3-be23-733bdeedef04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:36.070923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9a980f65-37c7-4fe3-be23-733bdeedef04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:36.114449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f929f80d-9465-471e-af22-0b74c0d25ea1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:36.165807 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f929f80d-9465-471e-af22-0b74c0d25ea1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.300880 Sep 06 16:19:36.167602 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 280/571] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:35 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:36.369801 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9a980f65-37c7-4fe3-be23-733bdeedef04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:36.381826 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9a980f65-37c7-4fe3-be23-733bdeedef04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:36.383139 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b254ed6c-dceb-4b2f-87a4-69c091ef46bc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:36.383738 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9a980f65-37c7-4fe3-be23-733bdeedef04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:36.384596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b254ed6c-dceb-4b2f-87a4-69c091ef46bc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:36.385385 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9a980f65-37c7-4fe3-be23-733bdeedef04 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.362297 Sep 06 16:19:36.386093 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 292/572] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:36 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:36.393551 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b254ed6c-dceb-4b2f-87a4-69c091ef46bc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:36.394642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b254ed6c-dceb-4b2f-87a4-69c091ef46bc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:36.395255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b254ed6c-dceb-4b2f-87a4-69c091ef46bc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:36.396140 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b254ed6c-dceb-4b2f-87a4-69c091ef46bc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:36.396733 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b254ed6c-dceb-4b2f-87a4-69c091ef46bc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:36.397342 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b254ed6c-dceb-4b2f-87a4-69c091ef46bc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:36.480820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b254ed6c-dceb-4b2f-87a4-69c091ef46bc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:36.499407 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b254ed6c-dceb-4b2f-87a4-69c091ef46bc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1306 microversion: 2.1 time: 0.121071 Sep 06 16:19:36.512790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 281/573] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:36 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1306 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:37.203637 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f7f6e413-1714-494e-84aa-575e571fcc58 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:37.204282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f7f6e413-1714-494e-84aa-575e571fcc58 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:37.218877 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f7f6e413-1714-494e-84aa-575e571fcc58 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:37.219676 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f7f6e413-1714-494e-84aa-575e571fcc58 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:37.220292 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f7f6e413-1714-494e-84aa-575e571fcc58 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:37.221208 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f7f6e413-1714-494e-84aa-575e571fcc58 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:37.221822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f7f6e413-1714-494e-84aa-575e571fcc58 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:37.222452 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f7f6e413-1714-494e-84aa-575e571fcc58 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:37.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f7f6e413-1714-494e-84aa-575e571fcc58 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:37.426083 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-89b4f6c9-c68a-49d4-b5cf-6a9a4b7a4559 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:37.427343 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-89b4f6c9-c68a-49d4-b5cf-6a9a4b7a4559 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:37.440036 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f7f6e413-1714-494e-84aa-575e571fcc58 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.240329 Sep 06 16:19:37.445641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 293/574] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:37 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:37.446358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-89b4f6c9-c68a-49d4-b5cf-6a9a4b7a4559 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:37.447337 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-89b4f6c9-c68a-49d4-b5cf-6a9a4b7a4559 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:37.447974 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-89b4f6c9-c68a-49d4-b5cf-6a9a4b7a4559 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:37.449070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-89b4f6c9-c68a-49d4-b5cf-6a9a4b7a4559 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:37.450015 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-89b4f6c9-c68a-49d4-b5cf-6a9a4b7a4559 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:37.450656 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-89b4f6c9-c68a-49d4-b5cf-6a9a4b7a4559 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:37.525874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-83f486c2-7950-4ba2-b67d-d1998704e135 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:37.526640 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-83f486c2-7950-4ba2-b67d-d1998704e135 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:37.534712 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83f486c2-7950-4ba2-b67d-d1998704e135 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:37.542594 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83f486c2-7950-4ba2-b67d-d1998704e135 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:37.543424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83f486c2-7950-4ba2-b67d-d1998704e135 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:37.544366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83f486c2-7950-4ba2-b67d-d1998704e135 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:37.545038 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83f486c2-7950-4ba2-b67d-d1998704e135 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:37.545457 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83f486c2-7950-4ba2-b67d-d1998704e135 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:37.655965 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-83f486c2-7950-4ba2-b67d-d1998704e135 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:37.678055 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-83f486c2-7950-4ba2-b67d-d1998704e135 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1304 microversion: 2.1 time: 0.156021 Sep 06 16:19:37.679297 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 294/575] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:37 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:37.766559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-89b4f6c9-c68a-49d4-b5cf-6a9a4b7a4559 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:37.775760 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-89b4f6c9-c68a-49d4-b5cf-6a9a4b7a4559 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:37.777312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-89b4f6c9-c68a-49d4-b5cf-6a9a4b7a4559 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:37.782491 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-89b4f6c9-c68a-49d4-b5cf-6a9a4b7a4559 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.361814 Sep 06 16:19:37.785428 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 282/576] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:37 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:37.972494 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-b17a9a85-e560-409a-bb0e-2077a77b295c req-15e53313-9a14-47c2-934b-0c1c2eb1a82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e546ddd0-81de-42c6-8fbd-6d660af7feba", "name": "network-vif-plugged", "status": "completed", "tag": "12e1e4c5-4f3a-4faf-9909-3984c992f9b6"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:37.986265 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-b17a9a85-e560-409a-bb0e-2077a77b295c req-15e53313-9a14-47c2-934b-0c1c2eb1a82d service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:37.987420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-b17a9a85-e560-409a-bb0e-2077a77b295c req-15e53313-9a14-47c2-934b-0c1c2eb1a82d service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:37.988414 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-b17a9a85-e560-409a-bb0e-2077a77b295c req-15e53313-9a14-47c2-934b-0c1c2eb1a82d service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:38.002188 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-b17a9a85-e560-409a-bb0e-2077a77b295c req-15e53313-9a14-47c2-934b-0c1c2eb1a82d service nova] Creating event network-vif-plugged:12e1e4c5-4f3a-4faf-9909-3984c992f9b6 for instance e546ddd0-81de-42c6-8fbd-6d660af7feba on hv-cinder-85221 Sep 06 16:19:38.017449 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-b17a9a85-e560-409a-bb0e-2077a77b295c req-15e53313-9a14-47c2-934b-0c1c2eb1a82d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049139 Sep 06 16:19:38.018077 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 295/577] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:19:38.471036 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-817e4cb1-1d47-4d71-b623-04584dba0634 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:38.472221 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-817e4cb1-1d47-4d71-b623-04584dba0634 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:38.488996 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-817e4cb1-1d47-4d71-b623-04584dba0634 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:38.489504 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-817e4cb1-1d47-4d71-b623-04584dba0634 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:38.489950 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-817e4cb1-1d47-4d71-b623-04584dba0634 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:38.490684 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-817e4cb1-1d47-4d71-b623-04584dba0634 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:38.491130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-817e4cb1-1d47-4d71-b623-04584dba0634 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:38.491736 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-817e4cb1-1d47-4d71-b623-04584dba0634 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:38.709227 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-15b3ba17-d14b-4e92-b491-c8966bb9717e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:38.709988 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-15b3ba17-d14b-4e92-b491-c8966bb9717e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:38.712322 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:38.718982 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-15b3ba17-d14b-4e92-b491-c8966bb9717e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:38.719904 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-15b3ba17-d14b-4e92-b491-c8966bb9717e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:38.720575 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-15b3ba17-d14b-4e92-b491-c8966bb9717e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:38.721437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-15b3ba17-d14b-4e92-b491-c8966bb9717e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:38.722019 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-15b3ba17-d14b-4e92-b491-c8966bb9717e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:38.722542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-15b3ba17-d14b-4e92-b491-c8966bb9717e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:38.780832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-817e4cb1-1d47-4d71-b623-04584dba0634 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:38.796909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-817e4cb1-1d47-4d71-b623-04584dba0634 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.331164 Sep 06 16:19:38.799976 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 283/578] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:38 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:38.836362 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-92dbf280-a0e3-43a4-a3fd-6bf396b40800 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:38.837007 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-92dbf280-a0e3-43a4-a3fd-6bf396b40800 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:38.843233 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-92dbf280-a0e3-43a4-a3fd-6bf396b40800 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:38.843724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-92dbf280-a0e3-43a4-a3fd-6bf396b40800 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:38.844656 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-92dbf280-a0e3-43a4-a3fd-6bf396b40800 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:38.845497 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-92dbf280-a0e3-43a4-a3fd-6bf396b40800 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:38.845959 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-92dbf280-a0e3-43a4-a3fd-6bf396b40800 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:38.846385 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-92dbf280-a0e3-43a4-a3fd-6bf396b40800 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:38.897149 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-15b3ba17-d14b-4e92-b491-c8966bb9717e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:38.907672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-15b3ba17-d14b-4e92-b491-c8966bb9717e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1371 microversion: 2.1 time: 0.206211 Sep 06 16:19:38.908878 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 296/579] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:38 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:39.072661 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-92dbf280-a0e3-43a4-a3fd-6bf396b40800 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:39.088422 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-92dbf280-a0e3-43a4-a3fd-6bf396b40800 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:39.091700 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-92dbf280-a0e3-43a4-a3fd-6bf396b40800 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:39.096570 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-92dbf280-a0e3-43a4-a3fd-6bf396b40800 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.266053 Sep 06 16:19:39.098608 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 284/580] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:38 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:39.397998 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-9dba24ea-b5e2-4f80-a299-b13c4437ac5a req-83d28450-0a3a-4067-a248-4d730536d673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ff1c2e-7944-4480-8fe9-47bf5417cbd6", "tag": "72ac5ea6-8d72-4bdb-9f41-ad02915d59c5"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:39.411060 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-9dba24ea-b5e2-4f80-a299-b13c4437ac5a req-83d28450-0a3a-4067-a248-4d730536d673 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:39.411868 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-9dba24ea-b5e2-4f80-a299-b13c4437ac5a req-83d28450-0a3a-4067-a248-4d730536d673 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:39.412472 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-9dba24ea-b5e2-4f80-a299-b13c4437ac5a req-83d28450-0a3a-4067-a248-4d730536d673 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:39.429219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-9dba24ea-b5e2-4f80-a299-b13c4437ac5a req-83d28450-0a3a-4067-a248-4d730536d673 service nova] Creating event network-changed:72ac5ea6-8d72-4bdb-9f41-ad02915d59c5 for instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 on hv-cinder-85221 Sep 06 16:19:39.435844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-9dba24ea-b5e2-4f80-a299-b13c4437ac5a req-83d28450-0a3a-4067-a248-4d730536d673 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042138 Sep 06 16:19:39.438599 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 297/581] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:19:39.827796 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-14d41c7e-09ed-48a1-807d-86691bd4b795 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:39.828431 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-14d41c7e-09ed-48a1-807d-86691bd4b795 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:39.835151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-14d41c7e-09ed-48a1-807d-86691bd4b795 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:39.835623 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-14d41c7e-09ed-48a1-807d-86691bd4b795 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:39.836047 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-14d41c7e-09ed-48a1-807d-86691bd4b795 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:39.836737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-14d41c7e-09ed-48a1-807d-86691bd4b795 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:39.837202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-14d41c7e-09ed-48a1-807d-86691bd4b795 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:39.837644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-14d41c7e-09ed-48a1-807d-86691bd4b795 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:39.935475 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-310b3135-ca28-4ecb-9bf7-ae2aaf1ca634 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:39.936882 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-310b3135-ca28-4ecb-9bf7-ae2aaf1ca634 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:39.944304 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-310b3135-ca28-4ecb-9bf7-ae2aaf1ca634 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:39.945065 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-310b3135-ca28-4ecb-9bf7-ae2aaf1ca634 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:39.945675 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-310b3135-ca28-4ecb-9bf7-ae2aaf1ca634 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:39.946574 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-310b3135-ca28-4ecb-9bf7-ae2aaf1ca634 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:39.947190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-310b3135-ca28-4ecb-9bf7-ae2aaf1ca634 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:39.948417 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-310b3135-ca28-4ecb-9bf7-ae2aaf1ca634 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:40.020224 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-14d41c7e-09ed-48a1-807d-86691bd4b795 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:40.032069 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-14d41c7e-09ed-48a1-807d-86691bd4b795 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.208265 Sep 06 16:19:40.033389 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 285/582] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:39 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:40.124697 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3814642d-293c-4e57-b9bb-188586b444a6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:40.126195 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-3814642d-293c-4e57-b9bb-188586b444a6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:40.142443 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3814642d-293c-4e57-b9bb-188586b444a6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:40.143309 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3814642d-293c-4e57-b9bb-188586b444a6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:40.144119 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3814642d-293c-4e57-b9bb-188586b444a6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:40.146352 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3814642d-293c-4e57-b9bb-188586b444a6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:40.148971 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3814642d-293c-4e57-b9bb-188586b444a6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:40.149749 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3814642d-293c-4e57-b9bb-188586b444a6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:40.157578 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-310b3135-ca28-4ecb-9bf7-ae2aaf1ca634 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:40.169021 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-310b3135-ca28-4ecb-9bf7-ae2aaf1ca634 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1371 microversion: 2.1 time: 0.238085 Sep 06 16:19:40.184717 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 298/583] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:39 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:40.662705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3814642d-293c-4e57-b9bb-188586b444a6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:40.672005 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3814642d-293c-4e57-b9bb-188586b444a6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:40.674269 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3814642d-293c-4e57-b9bb-188586b444a6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:40.676345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-3814642d-293c-4e57-b9bb-188586b444a6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.556550 Sep 06 16:19:40.677518 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 286/584] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:40 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:19:41.056679 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2fa012a7-a831-4fd6-abd8-93b4b90b26c6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:41.057604 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2fa012a7-a831-4fd6-abd8-93b4b90b26c6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:41.059649 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:41.061791 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=6 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:41.067690 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2fa012a7-a831-4fd6-abd8-93b4b90b26c6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:41.068184 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2fa012a7-a831-4fd6-abd8-93b4b90b26c6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:41.068615 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2fa012a7-a831-4fd6-abd8-93b4b90b26c6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:41.069342 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2fa012a7-a831-4fd6-abd8-93b4b90b26c6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:41.069970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2fa012a7-a831-4fd6-abd8-93b4b90b26c6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:41.071817 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2fa012a7-a831-4fd6-abd8-93b4b90b26c6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:41.194014 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0ef10983-073c-4022-83c0-270be2d0d24d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:41.194639 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0ef10983-073c-4022-83c0-270be2d0d24d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:41.197209 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=6 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:41.206704 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0ef10983-073c-4022-83c0-270be2d0d24d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:41.207701 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0ef10983-073c-4022-83c0-270be2d0d24d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:41.208512 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0ef10983-073c-4022-83c0-270be2d0d24d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:41.209575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0ef10983-073c-4022-83c0-270be2d0d24d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:41.210285 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0ef10983-073c-4022-83c0-270be2d0d24d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:41.211276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0ef10983-073c-4022-83c0-270be2d0d24d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:41.319398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2fa012a7-a831-4fd6-abd8-93b4b90b26c6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:41.330694 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2fa012a7-a831-4fd6-abd8-93b4b90b26c6 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1319 microversion: 2.1 time: 0.278159 Sep 06 16:19:41.331860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 299/585] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:41 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:41.592464 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0ef10983-073c-4022-83c0-270be2d0d24d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:41.598180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:41.603620 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0ef10983-073c-4022-83c0-270be2d0d24d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1371 microversion: 2.1 time: 0.414086 Sep 06 16:19:41.619564 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 287/586] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:41 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1371 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:41.704547 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5ffb143a-9d5e-40a8-a4fd-3fb815a06fc9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:41.705743 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5ffb143a-9d5e-40a8-a4fd-3fb815a06fc9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:41.713160 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5ffb143a-9d5e-40a8-a4fd-3fb815a06fc9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:41.713639 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5ffb143a-9d5e-40a8-a4fd-3fb815a06fc9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:41.714437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5ffb143a-9d5e-40a8-a4fd-3fb815a06fc9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:41.715306 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5ffb143a-9d5e-40a8-a4fd-3fb815a06fc9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:41.716058 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5ffb143a-9d5e-40a8-a4fd-3fb815a06fc9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:41.716692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5ffb143a-9d5e-40a8-a4fd-3fb815a06fc9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:41.896656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5ffb143a-9d5e-40a8-a4fd-3fb815a06fc9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:41.906253 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5ffb143a-9d5e-40a8-a4fd-3fb815a06fc9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:41.908811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5ffb143a-9d5e-40a8-a4fd-3fb815a06fc9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:41.910525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5ffb143a-9d5e-40a8-a4fd-3fb815a06fc9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.212218 Sep 06 16:19:41.911929 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 300/587] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:41 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:19:42.363588 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1fc9a909-09d1-4a52-a1b9-2ed391e5e08c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:42.363588 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1fc9a909-09d1-4a52-a1b9-2ed391e5e08c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:42.369663 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fc9a909-09d1-4a52-a1b9-2ed391e5e08c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:42.370622 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fc9a909-09d1-4a52-a1b9-2ed391e5e08c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:42.371408 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fc9a909-09d1-4a52-a1b9-2ed391e5e08c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:42.372426 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fc9a909-09d1-4a52-a1b9-2ed391e5e08c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:42.373139 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fc9a909-09d1-4a52-a1b9-2ed391e5e08c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:42.374062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fc9a909-09d1-4a52-a1b9-2ed391e5e08c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:42.571980 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1fc9a909-09d1-4a52-a1b9-2ed391e5e08c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:42.582860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1fc9a909-09d1-4a52-a1b9-2ed391e5e08c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1509 microversion: 2.1 time: 0.225952 Sep 06 16:19:42.584170 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 288/588] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:42 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:42.634326 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-88023ce3-33eb-4d5d-991f-0278f49cdfae tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:42.636179 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-88023ce3-33eb-4d5d-991f-0278f49cdfae tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:42.644897 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-88023ce3-33eb-4d5d-991f-0278f49cdfae tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:42.645396 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-88023ce3-33eb-4d5d-991f-0278f49cdfae tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:42.645824 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-88023ce3-33eb-4d5d-991f-0278f49cdfae tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:42.646511 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-88023ce3-33eb-4d5d-991f-0278f49cdfae tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:42.647705 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-88023ce3-33eb-4d5d-991f-0278f49cdfae tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:42.648282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-88023ce3-33eb-4d5d-991f-0278f49cdfae tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:42.875263 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-88023ce3-33eb-4d5d-991f-0278f49cdfae tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:42.898772 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-88023ce3-33eb-4d5d-991f-0278f49cdfae tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1371 microversion: 2.1 time: 0.265795 Sep 06 16:19:42.917726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 301/589] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:42 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:42.937972 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5272a1e9-13d8-414f-8cec-7493f888dcca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:42.938598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5272a1e9-13d8-414f-8cec-7493f888dcca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:42.946200 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5272a1e9-13d8-414f-8cec-7493f888dcca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:42.946699 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5272a1e9-13d8-414f-8cec-7493f888dcca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:42.947127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5272a1e9-13d8-414f-8cec-7493f888dcca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:42.948358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5272a1e9-13d8-414f-8cec-7493f888dcca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:42.948358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5272a1e9-13d8-414f-8cec-7493f888dcca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:42.948986 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5272a1e9-13d8-414f-8cec-7493f888dcca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:43.124260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5272a1e9-13d8-414f-8cec-7493f888dcca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:43.136884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5272a1e9-13d8-414f-8cec-7493f888dcca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:43.138947 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5272a1e9-13d8-414f-8cec-7493f888dcca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:43.140478 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5272a1e9-13d8-414f-8cec-7493f888dcca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.206843 Sep 06 16:19:43.141449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 289/590] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:42 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:43.932246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-834808d2-cfc3-4498-80ad-a489288a6bfc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:43.934571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-834808d2-cfc3-4498-80ad-a489288a6bfc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:43.945472 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-834808d2-cfc3-4498-80ad-a489288a6bfc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:43.946253 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-834808d2-cfc3-4498-80ad-a489288a6bfc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:43.947262 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-834808d2-cfc3-4498-80ad-a489288a6bfc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:43.948391 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-834808d2-cfc3-4498-80ad-a489288a6bfc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:43.949219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-834808d2-cfc3-4498-80ad-a489288a6bfc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:43.949867 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-834808d2-cfc3-4498-80ad-a489288a6bfc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:44.185754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-85ea5a69-618d-47e7-8c6d-188ecd0cfcee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:44.189484 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-85ea5a69-618d-47e7-8c6d-188ecd0cfcee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:44.203355 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85ea5a69-618d-47e7-8c6d-188ecd0cfcee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:44.206309 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85ea5a69-618d-47e7-8c6d-188ecd0cfcee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:44.211313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85ea5a69-618d-47e7-8c6d-188ecd0cfcee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:44.212703 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85ea5a69-618d-47e7-8c6d-188ecd0cfcee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:44.214267 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85ea5a69-618d-47e7-8c6d-188ecd0cfcee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:44.215684 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85ea5a69-618d-47e7-8c6d-188ecd0cfcee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:44.298835 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-834808d2-cfc3-4498-80ad-a489288a6bfc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:44.309734 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-834808d2-cfc3-4498-80ad-a489288a6bfc tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1371 microversion: 2.1 time: 0.388257 Sep 06 16:19:44.311151 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 302/591] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:43 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1371 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:44.497527 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-85ea5a69-618d-47e7-8c6d-188ecd0cfcee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:44.506729 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-85ea5a69-618d-47e7-8c6d-188ecd0cfcee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:44.508631 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-85ea5a69-618d-47e7-8c6d-188ecd0cfcee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:44.509832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-85ea5a69-618d-47e7-8c6d-188ecd0cfcee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.332299 Sep 06 16:19:44.530657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 290/592] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:44 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:45.341205 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a118f4e6-f9c7-4a0d-a959-474d545c0722 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:45.342187 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a118f4e6-f9c7-4a0d-a959-474d545c0722 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:45.349053 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a118f4e6-f9c7-4a0d-a959-474d545c0722 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:45.349564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a118f4e6-f9c7-4a0d-a959-474d545c0722 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:45.349989 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a118f4e6-f9c7-4a0d-a959-474d545c0722 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:45.350713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a118f4e6-f9c7-4a0d-a959-474d545c0722 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:45.351156 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a118f4e6-f9c7-4a0d-a959-474d545c0722 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:45.351566 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a118f4e6-f9c7-4a0d-a959-474d545c0722 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:45.542754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d0cae271-82bc-41d5-89f9-19028ca6a767 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:45.544148 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d0cae271-82bc-41d5-89f9-19028ca6a767 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:45.552873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d0cae271-82bc-41d5-89f9-19028ca6a767 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:45.554047 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d0cae271-82bc-41d5-89f9-19028ca6a767 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:45.554999 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d0cae271-82bc-41d5-89f9-19028ca6a767 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:45.556481 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d0cae271-82bc-41d5-89f9-19028ca6a767 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:45.557469 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d0cae271-82bc-41d5-89f9-19028ca6a767 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:45.558392 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d0cae271-82bc-41d5-89f9-19028ca6a767 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:45.576440 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a118f4e6-f9c7-4a0d-a959-474d545c0722 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:45.594264 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a118f4e6-f9c7-4a0d-a959-474d545c0722 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1371 microversion: 2.1 time: 0.258405 Sep 06 16:19:45.595243 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 303/593] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:45 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:45.861910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d0cae271-82bc-41d5-89f9-19028ca6a767 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:45.873437 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d0cae271-82bc-41d5-89f9-19028ca6a767 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:45.878319 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d0cae271-82bc-41d5-89f9-19028ca6a767 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:45.879643 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d0cae271-82bc-41d5-89f9-19028ca6a767 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.343214 Sep 06 16:19:45.897383 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 291/594] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:45 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:46.623512 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e4d7bb26-39db-4b51-bcbf-c1073ae1eb05 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:46.624433 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e4d7bb26-39db-4b51-bcbf-c1073ae1eb05 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:46.631210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4d7bb26-39db-4b51-bcbf-c1073ae1eb05 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:46.632117 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4d7bb26-39db-4b51-bcbf-c1073ae1eb05 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:46.632790 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4d7bb26-39db-4b51-bcbf-c1073ae1eb05 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:46.633730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4d7bb26-39db-4b51-bcbf-c1073ae1eb05 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:46.634249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4d7bb26-39db-4b51-bcbf-c1073ae1eb05 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:46.634950 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4d7bb26-39db-4b51-bcbf-c1073ae1eb05 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:46.908769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-59469dbc-080c-4fcc-ad0b-c8d0f85b0cbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:46.909523 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-59469dbc-080c-4fcc-ad0b-c8d0f85b0cbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:46.912883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e4d7bb26-39db-4b51-bcbf-c1073ae1eb05 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:46.918023 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-59469dbc-080c-4fcc-ad0b-c8d0f85b0cbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:46.918884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-59469dbc-080c-4fcc-ad0b-c8d0f85b0cbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:46.919533 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-59469dbc-080c-4fcc-ad0b-c8d0f85b0cbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:46.920505 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-59469dbc-080c-4fcc-ad0b-c8d0f85b0cbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:46.921192 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e4d7bb26-39db-4b51-bcbf-c1073ae1eb05 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1371 microversion: 2.1 time: 0.301654 Sep 06 16:19:46.921519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-59469dbc-080c-4fcc-ad0b-c8d0f85b0cbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:46.922486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-59469dbc-080c-4fcc-ad0b-c8d0f85b0cbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:46.922613 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 304/595] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:46 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:47.088628 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-59469dbc-080c-4fcc-ad0b-c8d0f85b0cbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:47.097976 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-59469dbc-080c-4fcc-ad0b-c8d0f85b0cbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:47.099596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-59469dbc-080c-4fcc-ad0b-c8d0f85b0cbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:47.100837 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-59469dbc-080c-4fcc-ad0b-c8d0f85b0cbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.197165 Sep 06 16:19:47.101444 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 292/596] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:46 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:19:47.947819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c97a31c0-1038-4003-b82c-1be056f515f7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:47.948435 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c97a31c0-1038-4003-b82c-1be056f515f7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:47.954950 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c97a31c0-1038-4003-b82c-1be056f515f7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:47.955452 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c97a31c0-1038-4003-b82c-1be056f515f7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:47.956100 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c97a31c0-1038-4003-b82c-1be056f515f7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:47.956889 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c97a31c0-1038-4003-b82c-1be056f515f7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:47.957369 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c97a31c0-1038-4003-b82c-1be056f515f7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:47.957774 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c97a31c0-1038-4003-b82c-1be056f515f7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:48.122916 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c97a31c0-1038-4003-b82c-1be056f515f7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:48.126900 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:48.129128 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-aca91987-d31a-44ee-a75c-43ed0338a0e5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:48.130086 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-aca91987-d31a-44ee-a75c-43ed0338a0e5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:48.136085 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c97a31c0-1038-4003-b82c-1be056f515f7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1371 microversion: 2.1 time: 0.192319 Sep 06 16:19:48.152362 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 305/597] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:47 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:48.152782 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-aca91987-d31a-44ee-a75c-43ed0338a0e5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:48.152782 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-aca91987-d31a-44ee-a75c-43ed0338a0e5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:48.152782 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-aca91987-d31a-44ee-a75c-43ed0338a0e5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:48.152782 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-aca91987-d31a-44ee-a75c-43ed0338a0e5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:48.153132 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-aca91987-d31a-44ee-a75c-43ed0338a0e5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:48.153132 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-aca91987-d31a-44ee-a75c-43ed0338a0e5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:48.306920 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-d506ab6b-4bc1-4525-ae72-68d92cded63d req-c73fb552-a6cd-42ed-acf8-ce263fcae037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ff1c2e-7944-4480-8fe9-47bf5417cbd6", "name": "network-vif-plugged", "status": "completed", "tag": "72ac5ea6-8d72-4bdb-9f41-ad02915d59c5"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:48.334153 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-d506ab6b-4bc1-4525-ae72-68d92cded63d req-c73fb552-a6cd-42ed-acf8-ce263fcae037 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:48.336139 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-d506ab6b-4bc1-4525-ae72-68d92cded63d req-c73fb552-a6cd-42ed-acf8-ce263fcae037 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:48.336936 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-d506ab6b-4bc1-4525-ae72-68d92cded63d req-c73fb552-a6cd-42ed-acf8-ce263fcae037 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:48.367826 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-d506ab6b-4bc1-4525-ae72-68d92cded63d req-c73fb552-a6cd-42ed-acf8-ce263fcae037 service nova] Creating event network-vif-plugged:72ac5ea6-8d72-4bdb-9f41-ad02915d59c5 for instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 on hv-cinder-85221 Sep 06 16:19:48.379066 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-d506ab6b-4bc1-4525-ae72-68d92cded63d req-c73fb552-a6cd-42ed-acf8-ce263fcae037 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077842 Sep 06 16:19:48.379868 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 306/598] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:19:48.392572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-aca91987-d31a-44ee-a75c-43ed0338a0e5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:48.403145 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-aca91987-d31a-44ee-a75c-43ed0338a0e5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:48.404905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-aca91987-d31a-44ee-a75c-43ed0338a0e5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:48.406180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-aca91987-d31a-44ee-a75c-43ed0338a0e5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.283395 Sep 06 16:19:48.416849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 293/599] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:48 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:49.165154 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c5ffd90f-2b9f-492a-8ae7-81d7f3d8e8e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:49.167388 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c5ffd90f-2b9f-492a-8ae7-81d7f3d8e8e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:49.178798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5ffd90f-2b9f-492a-8ae7-81d7f3d8e8e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:49.179614 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5ffd90f-2b9f-492a-8ae7-81d7f3d8e8e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:49.180337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5ffd90f-2b9f-492a-8ae7-81d7f3d8e8e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:49.181245 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5ffd90f-2b9f-492a-8ae7-81d7f3d8e8e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:49.182093 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5ffd90f-2b9f-492a-8ae7-81d7f3d8e8e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:49.182665 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5ffd90f-2b9f-492a-8ae7-81d7f3d8e8e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:49.353957 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c5ffd90f-2b9f-492a-8ae7-81d7f3d8e8e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:49.363688 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c5ffd90f-2b9f-492a-8ae7-81d7f3d8e8e7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1371 microversion: 2.1 time: 0.206800 Sep 06 16:19:49.364304 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 307/600] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:49 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:49.435844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d883652e-df49-402d-9a11-5f14f955e68f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:49.436718 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d883652e-df49-402d-9a11-5f14f955e68f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:49.444403 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d883652e-df49-402d-9a11-5f14f955e68f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:49.445289 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d883652e-df49-402d-9a11-5f14f955e68f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:49.445833 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d883652e-df49-402d-9a11-5f14f955e68f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:49.446606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d883652e-df49-402d-9a11-5f14f955e68f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:49.447125 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d883652e-df49-402d-9a11-5f14f955e68f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:49.447715 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d883652e-df49-402d-9a11-5f14f955e68f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:49.614586 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d883652e-df49-402d-9a11-5f14f955e68f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:49.631576 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d883652e-df49-402d-9a11-5f14f955e68f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:49.634746 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d883652e-df49-402d-9a11-5f14f955e68f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:49.636653 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d883652e-df49-402d-9a11-5f14f955e68f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.206015 Sep 06 16:19:49.648820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 294/601] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:49 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:50.389036 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fffbed6f-8133-4888-a657-dda7063da07e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:50.390617 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fffbed6f-8133-4888-a657-dda7063da07e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:50.398483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fffbed6f-8133-4888-a657-dda7063da07e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:50.399098 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fffbed6f-8133-4888-a657-dda7063da07e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:50.399884 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fffbed6f-8133-4888-a657-dda7063da07e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:50.400815 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fffbed6f-8133-4888-a657-dda7063da07e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:50.401447 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fffbed6f-8133-4888-a657-dda7063da07e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:50.402087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fffbed6f-8133-4888-a657-dda7063da07e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:50.665027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e0d41be7-1241-4a85-96bf-48a9f6aa9620 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:50.665607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e0d41be7-1241-4a85-96bf-48a9f6aa9620 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:50.685294 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e0d41be7-1241-4a85-96bf-48a9f6aa9620 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:50.686193 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e0d41be7-1241-4a85-96bf-48a9f6aa9620 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:50.686730 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e0d41be7-1241-4a85-96bf-48a9f6aa9620 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:50.687768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e0d41be7-1241-4a85-96bf-48a9f6aa9620 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:50.688489 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e0d41be7-1241-4a85-96bf-48a9f6aa9620 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:50.689246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e0d41be7-1241-4a85-96bf-48a9f6aa9620 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:50.803113 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fffbed6f-8133-4888-a657-dda7063da07e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:50.814369 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fffbed6f-8133-4888-a657-dda7063da07e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1371 microversion: 2.1 time: 0.430113 Sep 06 16:19:50.832410 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 308/602] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:50 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1371 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:50.862409 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e0d41be7-1241-4a85-96bf-48a9f6aa9620 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:50.878169 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e0d41be7-1241-4a85-96bf-48a9f6aa9620 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:50.880283 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e0d41be7-1241-4a85-96bf-48a9f6aa9620 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:50.881684 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e0d41be7-1241-4a85-96bf-48a9f6aa9620 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.222988 Sep 06 16:19:50.882933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 295/603] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:50 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:19:51.839855 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-acf9bab2-bf0e-4f71-8058-47dd7dd2fed3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:51.840476 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-acf9bab2-bf0e-4f71-8058-47dd7dd2fed3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:51.847454 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-acf9bab2-bf0e-4f71-8058-47dd7dd2fed3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:51.847943 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-acf9bab2-bf0e-4f71-8058-47dd7dd2fed3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:51.848608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-acf9bab2-bf0e-4f71-8058-47dd7dd2fed3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:51.849540 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-acf9bab2-bf0e-4f71-8058-47dd7dd2fed3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:51.849990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-acf9bab2-bf0e-4f71-8058-47dd7dd2fed3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:51.850407 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-acf9bab2-bf0e-4f71-8058-47dd7dd2fed3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:51.908247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-537241fd-2ccf-42ef-90cf-35fd42fecc57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:51.909159 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-537241fd-2ccf-42ef-90cf-35fd42fecc57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:51.917896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-537241fd-2ccf-42ef-90cf-35fd42fecc57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:51.918639 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-537241fd-2ccf-42ef-90cf-35fd42fecc57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:51.919293 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-537241fd-2ccf-42ef-90cf-35fd42fecc57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:51.920422 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-537241fd-2ccf-42ef-90cf-35fd42fecc57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:51.921279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-537241fd-2ccf-42ef-90cf-35fd42fecc57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:51.921889 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-537241fd-2ccf-42ef-90cf-35fd42fecc57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:52.036681 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-acf9bab2-bf0e-4f71-8058-47dd7dd2fed3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:52.051363 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-acf9bab2-bf0e-4f71-8058-47dd7dd2fed3 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1565 microversion: 2.1 time: 0.215392 Sep 06 16:19:52.052352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 309/604] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:51 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1565 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:52.091478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-67b2b76e-8cfd-4562-ab7f-885f22600185 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:52.092247 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-67b2b76e-8cfd-4562-ab7f-885f22600185 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:52.099860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-67b2b76e-8cfd-4562-ab7f-885f22600185 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:52.100664 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-67b2b76e-8cfd-4562-ab7f-885f22600185 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:52.101143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-67b2b76e-8cfd-4562-ab7f-885f22600185 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:52.102050 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-67b2b76e-8cfd-4562-ab7f-885f22600185 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:52.109778 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-67b2b76e-8cfd-4562-ab7f-885f22600185 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:52.110635 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-67b2b76e-8cfd-4562-ab7f-885f22600185 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:52.204782 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-537241fd-2ccf-42ef-90cf-35fd42fecc57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:52.213962 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-537241fd-2ccf-42ef-90cf-35fd42fecc57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:52.218548 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-537241fd-2ccf-42ef-90cf-35fd42fecc57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:52.218779 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-67b2b76e-8cfd-4562-ab7f-885f22600185 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146002 Sep 06 16:19:52.219153 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 310/605] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 6 16:19:52 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:19:52.222765 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-537241fd-2ccf-42ef-90cf-35fd42fecc57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.318890 Sep 06 16:19:52.224194 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 296/606] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:51 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:53.261713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b8c59c5f-167f-4515-9de7-eddbb1808b75 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:53.261713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b8c59c5f-167f-4515-9de7-eddbb1808b75 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:53.269161 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b8c59c5f-167f-4515-9de7-eddbb1808b75 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:53.269161 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b8c59c5f-167f-4515-9de7-eddbb1808b75 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:53.269161 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b8c59c5f-167f-4515-9de7-eddbb1808b75 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:53.269936 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b8c59c5f-167f-4515-9de7-eddbb1808b75 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:53.270460 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b8c59c5f-167f-4515-9de7-eddbb1808b75 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:53.270951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b8c59c5f-167f-4515-9de7-eddbb1808b75 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:53.510025 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b8c59c5f-167f-4515-9de7-eddbb1808b75 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:53.520585 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b8c59c5f-167f-4515-9de7-eddbb1808b75 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:53.522602 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b8c59c5f-167f-4515-9de7-eddbb1808b75 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:53.540832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b8c59c5f-167f-4515-9de7-eddbb1808b75 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.286818 Sep 06 16:19:53.553156 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 311/607] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:53 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:53.676799 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-5a46ff6b-55ed-47f8-9177-b4509335de61 req-b06f1fc0-66d4-4dd5-834c-fc96a954c085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ff1c2e-7944-4480-8fe9-47bf5417cbd6", "tag": "72ac5ea6-8d72-4bdb-9f41-ad02915d59c5"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:53.689632 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5a46ff6b-55ed-47f8-9177-b4509335de61 req-b06f1fc0-66d4-4dd5-834c-fc96a954c085 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:53.690173 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5a46ff6b-55ed-47f8-9177-b4509335de61 req-b06f1fc0-66d4-4dd5-834c-fc96a954c085 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:53.690669 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5a46ff6b-55ed-47f8-9177-b4509335de61 req-b06f1fc0-66d4-4dd5-834c-fc96a954c085 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:53.709577 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-5a46ff6b-55ed-47f8-9177-b4509335de61 req-b06f1fc0-66d4-4dd5-834c-fc96a954c085 service nova] Creating event network-changed:72ac5ea6-8d72-4bdb-9f41-ad02915d59c5 for instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 on hv-cinder-85221 Sep 06 16:19:53.718813 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-5a46ff6b-55ed-47f8-9177-b4509335de61 req-b06f1fc0-66d4-4dd5-834c-fc96a954c085 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045193 Sep 06 16:19:53.726979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 297/608] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:19:54.571951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3c950207-1cbf-4da9-934c-31a67b0c0656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:54.572548 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3c950207-1cbf-4da9-934c-31a67b0c0656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:54.579241 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c950207-1cbf-4da9-934c-31a67b0c0656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:54.580080 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c950207-1cbf-4da9-934c-31a67b0c0656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:54.580512 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c950207-1cbf-4da9-934c-31a67b0c0656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:54.581324 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c950207-1cbf-4da9-934c-31a67b0c0656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:54.581948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c950207-1cbf-4da9-934c-31a67b0c0656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:54.582377 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c950207-1cbf-4da9-934c-31a67b0c0656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:54.736920 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3c950207-1cbf-4da9-934c-31a67b0c0656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:54.745502 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3c950207-1cbf-4da9-934c-31a67b0c0656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:54.747084 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3c950207-1cbf-4da9-934c-31a67b0c0656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:54.748297 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3c950207-1cbf-4da9-934c-31a67b0c0656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1744 microversion: 2.20 time: 0.180484 Sep 06 16:19:54.748887 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 312/609] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:54 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:55.784479 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-07c806e5-0680-4b33-9cab-223fca717cea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:55.785213 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-07c806e5-0680-4b33-9cab-223fca717cea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:55.792989 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07c806e5-0680-4b33-9cab-223fca717cea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:55.793762 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07c806e5-0680-4b33-9cab-223fca717cea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:55.794877 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07c806e5-0680-4b33-9cab-223fca717cea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:55.795543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07c806e5-0680-4b33-9cab-223fca717cea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:55.796248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07c806e5-0680-4b33-9cab-223fca717cea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:55.796826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07c806e5-0680-4b33-9cab-223fca717cea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:55.955419 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-07c806e5-0680-4b33-9cab-223fca717cea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:55.970309 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-07c806e5-0680-4b33-9cab-223fca717cea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:55.973206 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-07c806e5-0680-4b33-9cab-223fca717cea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:55.975338 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-07c806e5-0680-4b33-9cab-223fca717cea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1744 microversion: 2.20 time: 0.195145 Sep 06 16:19:55.976301 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 298/610] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:55 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1744 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:57.005283 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-8844ea64-9d6d-4393-a8e9-9fdffae9c77b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:57.005283 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-8844ea64-9d6d-4393-a8e9-9fdffae9c77b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:57.009640 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8844ea64-9d6d-4393-a8e9-9fdffae9c77b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:57.010130 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8844ea64-9d6d-4393-a8e9-9fdffae9c77b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:57.010554 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8844ea64-9d6d-4393-a8e9-9fdffae9c77b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:57.011254 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8844ea64-9d6d-4393-a8e9-9fdffae9c77b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:57.011699 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8844ea64-9d6d-4393-a8e9-9fdffae9c77b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:57.012114 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8844ea64-9d6d-4393-a8e9-9fdffae9c77b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:57.151986 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8844ea64-9d6d-4393-a8e9-9fdffae9c77b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:57.160850 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8844ea64-9d6d-4393-a8e9-9fdffae9c77b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:57.162298 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8844ea64-9d6d-4393-a8e9-9fdffae9c77b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:57.163495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-8844ea64-9d6d-4393-a8e9-9fdffae9c77b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1744 microversion: 2.20 time: 0.165274 Sep 06 16:19:57.164044 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 313/611] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:56 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:58.189533 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-087ae456-689a-440a-8065-4842d30f039e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:58.190025 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-087ae456-689a-440a-8065-4842d30f039e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:58.197336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-087ae456-689a-440a-8065-4842d30f039e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:58.197829 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-087ae456-689a-440a-8065-4842d30f039e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:58.198260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-087ae456-689a-440a-8065-4842d30f039e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:58.198959 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-087ae456-689a-440a-8065-4842d30f039e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:58.199409 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-087ae456-689a-440a-8065-4842d30f039e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:58.199826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-087ae456-689a-440a-8065-4842d30f039e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:58.232178 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-c9445128-992e-4754-89fd-aea74c6c3fe7 req-735933d0-c38a-4cd7-8a6a-84d00ced4e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2", "name": "network-vif-plugged", "status": "completed", "tag": "4b0a3d0f-c85a-40a8-b906-23e0735edd5e"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:58.250932 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c9445128-992e-4754-89fd-aea74c6c3fe7 req-735933d0-c38a-4cd7-8a6a-84d00ced4e02 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:58.251778 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c9445128-992e-4754-89fd-aea74c6c3fe7 req-735933d0-c38a-4cd7-8a6a-84d00ced4e02 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:58.252432 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c9445128-992e-4754-89fd-aea74c6c3fe7 req-735933d0-c38a-4cd7-8a6a-84d00ced4e02 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:58.271309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-c9445128-992e-4754-89fd-aea74c6c3fe7 req-735933d0-c38a-4cd7-8a6a-84d00ced4e02 service nova] Creating event network-vif-plugged:4b0a3d0f-c85a-40a8-b906-23e0735edd5e for instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 on hv-cinder-85221 Sep 06 16:19:58.277188 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-c9445128-992e-4754-89fd-aea74c6c3fe7 req-735933d0-c38a-4cd7-8a6a-84d00ced4e02 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049120 Sep 06 16:19:58.278470 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 314/612] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:19:58.396553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-087ae456-689a-440a-8065-4842d30f039e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:58.405131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-087ae456-689a-440a-8065-4842d30f039e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:58.406590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-087ae456-689a-440a-8065-4842d30f039e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:58.407764 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-087ae456-689a-440a-8065-4842d30f039e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1744 microversion: 2.20 time: 0.222340 Sep 06 16:19:58.408262 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 299/613] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:58 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:19:59.441156 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9aa663bf-ba40-4ebb-adeb-689c4e31cbbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:59.442001 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9aa663bf-ba40-4ebb-adeb-689c4e31cbbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:59.448739 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9aa663bf-ba40-4ebb-adeb-689c4e31cbbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:59.449267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9aa663bf-ba40-4ebb-adeb-689c4e31cbbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:59.449698 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9aa663bf-ba40-4ebb-adeb-689c4e31cbbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:59.450399 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9aa663bf-ba40-4ebb-adeb-689c4e31cbbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:59.450851 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9aa663bf-ba40-4ebb-adeb-689c4e31cbbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:59.451278 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9aa663bf-ba40-4ebb-adeb-689c4e31cbbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:59.602496 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9aa663bf-ba40-4ebb-adeb-689c4e31cbbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:59.614386 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9aa663bf-ba40-4ebb-adeb-689c4e31cbbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:59.615827 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9aa663bf-ba40-4ebb-adeb-689c4e31cbbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:59.617020 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9aa663bf-ba40-4ebb-adeb-689c4e31cbbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1744 microversion: 2.20 time: 0.185514 Sep 06 16:19:59.617609 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 315/614] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:19:59 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:00.641750 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6caf8115-d136-459e-9c66-20389506d770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:00.642274 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6caf8115-d136-459e-9c66-20389506d770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:00.644867 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=64 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:00.650730 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6caf8115-d136-459e-9c66-20389506d770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:00.651210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6caf8115-d136-459e-9c66-20389506d770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:00.651644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6caf8115-d136-459e-9c66-20389506d770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:00.652337 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6caf8115-d136-459e-9c66-20389506d770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:00.652796 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6caf8115-d136-459e-9c66-20389506d770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:00.653222 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6caf8115-d136-459e-9c66-20389506d770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:00.787710 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6caf8115-d136-459e-9c66-20389506d770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:00.796374 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6caf8115-d136-459e-9c66-20389506d770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:00.797846 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6caf8115-d136-459e-9c66-20389506d770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:00.798995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6caf8115-d136-459e-9c66-20389506d770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1744 microversion: 2.20 time: 0.161314 Sep 06 16:20:00.799562 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 300/615] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:00 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:01.828444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e35fc306-18ea-4d7f-83e6-d257290866ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:01.829098 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e35fc306-18ea-4d7f-83e6-d257290866ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:01.836886 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e35fc306-18ea-4d7f-83e6-d257290866ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:01.837509 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e35fc306-18ea-4d7f-83e6-d257290866ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:01.837891 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e35fc306-18ea-4d7f-83e6-d257290866ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:01.838646 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e35fc306-18ea-4d7f-83e6-d257290866ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:01.839074 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e35fc306-18ea-4d7f-83e6-d257290866ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:01.839486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e35fc306-18ea-4d7f-83e6-d257290866ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:01.895718 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-26f3661a-737d-43c1-b64c-0c6865ca6ab0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:01.896295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-26f3661a-737d-43c1-b64c-0c6865ca6ab0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:01.903070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-26f3661a-737d-43c1-b64c-0c6865ca6ab0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:01.903568 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-26f3661a-737d-43c1-b64c-0c6865ca6ab0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:01.904000 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-26f3661a-737d-43c1-b64c-0c6865ca6ab0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:01.904699 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-26f3661a-737d-43c1-b64c-0c6865ca6ab0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:01.905707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-26f3661a-737d-43c1-b64c-0c6865ca6ab0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:01.905707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-26f3661a-737d-43c1-b64c-0c6865ca6ab0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:01.942479 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-26f3661a-737d-43c1-b64c-0c6865ca6ab0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/ips" status: 200 len: 147 microversion: 2.1 time: 0.050716 Sep 06 16:20:01.943402 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 301/616] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 6 16:20:01 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/ips => generated 147 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:01.998398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e35fc306-18ea-4d7f-83e6-d257290866ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:02.006518 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e35fc306-18ea-4d7f-83e6-d257290866ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:02.007931 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e35fc306-18ea-4d7f-83e6-d257290866ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:02.009095 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e35fc306-18ea-4d7f-83e6-d257290866ae tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1744 microversion: 2.20 time: 0.186703 Sep 06 16:20:02.009653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 316/617] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:01 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:03.035754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4b68668d-52ad-431e-b3af-35e0c72171d1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:03.036318 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4b68668d-52ad-431e-b3af-35e0c72171d1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:03.043187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b68668d-52ad-431e-b3af-35e0c72171d1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:03.043670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b68668d-52ad-431e-b3af-35e0c72171d1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:03.044272 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b68668d-52ad-431e-b3af-35e0c72171d1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:03.045062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b68668d-52ad-431e-b3af-35e0c72171d1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:03.045511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b68668d-52ad-431e-b3af-35e0c72171d1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:03.045931 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b68668d-52ad-431e-b3af-35e0c72171d1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:03.181948 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4b68668d-52ad-431e-b3af-35e0c72171d1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:03.202318 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4b68668d-52ad-431e-b3af-35e0c72171d1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:03.203982 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4b68668d-52ad-431e-b3af-35e0c72171d1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:03.205786 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4b68668d-52ad-431e-b3af-35e0c72171d1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1744 microversion: 2.20 time: 0.174056 Sep 06 16:20:03.206418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 302/618] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:03 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:04.231937 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-eb304047-e1b5-4620-b35b-39d3ec13d97c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:04.232538 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-eb304047-e1b5-4620-b35b-39d3ec13d97c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:04.238989 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eb304047-e1b5-4620-b35b-39d3ec13d97c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:04.239477 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eb304047-e1b5-4620-b35b-39d3ec13d97c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:04.239912 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eb304047-e1b5-4620-b35b-39d3ec13d97c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:04.240607 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eb304047-e1b5-4620-b35b-39d3ec13d97c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:04.241079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eb304047-e1b5-4620-b35b-39d3ec13d97c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:04.241484 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eb304047-e1b5-4620-b35b-39d3ec13d97c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:04.408822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-eb304047-e1b5-4620-b35b-39d3ec13d97c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:04.419478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-eb304047-e1b5-4620-b35b-39d3ec13d97c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:04.421422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-eb304047-e1b5-4620-b35b-39d3ec13d97c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:04.423068 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-eb304047-e1b5-4620-b35b-39d3ec13d97c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1739 microversion: 2.20 time: 0.195132 Sep 06 16:20:04.423875 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 317/619] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:04 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:05.408678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b1abfe04-6af5-4559-99a0-577d5687f24a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59a768c5-e4cc-4c70-b478-288184a47f1e"}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:05.411548 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b1abfe04-6af5-4559-99a0-577d5687f24a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:05.418942 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b1abfe04-6af5-4559-99a0-577d5687f24a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:05.419870 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b1abfe04-6af5-4559-99a0-577d5687f24a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:05.420488 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b1abfe04-6af5-4559-99a0-577d5687f24a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:05.421439 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b1abfe04-6af5-4559-99a0-577d5687f24a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:05.421926 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b1abfe04-6af5-4559-99a0-577d5687f24a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:05.422424 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b1abfe04-6af5-4559-99a0-577d5687f24a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:05.454045 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-445c8146-292c-464b-b9bc-ea85c2a71154 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:05.455370 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-445c8146-292c-464b-b9bc-ea85c2a71154 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:05.462594 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-445c8146-292c-464b-b9bc-ea85c2a71154 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:05.463079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-445c8146-292c-464b-b9bc-ea85c2a71154 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:05.463509 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-445c8146-292c-464b-b9bc-ea85c2a71154 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:05.464217 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-445c8146-292c-464b-b9bc-ea85c2a71154 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:05.464659 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-445c8146-292c-464b-b9bc-ea85c2a71154 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:05.465238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-445c8146-292c-464b-b9bc-ea85c2a71154 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:05.642542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-445c8146-292c-464b-b9bc-ea85c2a71154 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:05.659445 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-445c8146-292c-464b-b9bc-ea85c2a71154 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:05.663071 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-445c8146-292c-464b-b9bc-ea85c2a71154 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:05.664688 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-445c8146-292c-464b-b9bc-ea85c2a71154 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1739 microversion: 2.20 time: 0.214680 Sep 06 16:20:05.667468 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 318/620] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:05 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:05.806952 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b1abfe04-6af5-4559-99a0-577d5687f24a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "POST /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401402 Sep 06 16:20:05.813583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 303/621] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:20:05 2022] POST /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:20:06.691530 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e69ebf27-231f-4707-9496-2bd1205af121 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:06.692320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e69ebf27-231f-4707-9496-2bd1205af121 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:06.702422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e69ebf27-231f-4707-9496-2bd1205af121 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:06.703588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e69ebf27-231f-4707-9496-2bd1205af121 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:06.704325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e69ebf27-231f-4707-9496-2bd1205af121 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:06.705561 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e69ebf27-231f-4707-9496-2bd1205af121 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:06.707208 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e69ebf27-231f-4707-9496-2bd1205af121 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:06.707959 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e69ebf27-231f-4707-9496-2bd1205af121 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:06.860210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e69ebf27-231f-4707-9496-2bd1205af121 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:06.872729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e69ebf27-231f-4707-9496-2bd1205af121 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:06.874409 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e69ebf27-231f-4707-9496-2bd1205af121 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:06.875778 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e69ebf27-231f-4707-9496-2bd1205af121 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1739 microversion: 2.20 time: 0.188407 Sep 06 16:20:06.876689 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 319/622] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:06 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:07.916239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9d3d65ce-8c59-4666-ad0b-ae63c1a98588 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:07.923088 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9d3d65ce-8c59-4666-ad0b-ae63c1a98588 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:07.930089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9d3d65ce-8c59-4666-ad0b-ae63c1a98588 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:07.930546 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9d3d65ce-8c59-4666-ad0b-ae63c1a98588 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:07.930974 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9d3d65ce-8c59-4666-ad0b-ae63c1a98588 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:07.931846 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9d3d65ce-8c59-4666-ad0b-ae63c1a98588 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:07.932412 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9d3d65ce-8c59-4666-ad0b-ae63c1a98588 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:07.932858 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9d3d65ce-8c59-4666-ad0b-ae63c1a98588 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:07.937909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:08.101691 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9d3d65ce-8c59-4666-ad0b-ae63c1a98588 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:08.119737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9d3d65ce-8c59-4666-ad0b-ae63c1a98588 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:08.121320 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9d3d65ce-8c59-4666-ad0b-ae63c1a98588 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:08.122865 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9d3d65ce-8c59-4666-ad0b-ae63c1a98588 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1739 microversion: 2.20 time: 0.219669 Sep 06 16:20:08.123593 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 304/623] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:07 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:09.150217 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f07c64a6-09e5-49b0-b96a-903657f54d0e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:09.150796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f07c64a6-09e5-49b0-b96a-903657f54d0e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:09.152884 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=48 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:09.159219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f07c64a6-09e5-49b0-b96a-903657f54d0e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:09.159715 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f07c64a6-09e5-49b0-b96a-903657f54d0e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:09.160469 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f07c64a6-09e5-49b0-b96a-903657f54d0e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:09.163347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f07c64a6-09e5-49b0-b96a-903657f54d0e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:09.164515 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f07c64a6-09e5-49b0-b96a-903657f54d0e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:09.165121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f07c64a6-09e5-49b0-b96a-903657f54d0e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:09.332236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f07c64a6-09e5-49b0-b96a-903657f54d0e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:09.341955 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f07c64a6-09e5-49b0-b96a-903657f54d0e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:09.343590 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f07c64a6-09e5-49b0-b96a-903657f54d0e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:09.344803 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f07c64a6-09e5-49b0-b96a-903657f54d0e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1739 microversion: 2.20 time: 0.198885 Sep 06 16:20:09.345316 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 320/624] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:09 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:10.370709 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0369d4c8-b079-44ea-9b72-e9b7d32364fe tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:10.371286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0369d4c8-b079-44ea-9b72-e9b7d32364fe tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:10.378814 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0369d4c8-b079-44ea-9b72-e9b7d32364fe tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:10.379328 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0369d4c8-b079-44ea-9b72-e9b7d32364fe tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:10.379766 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0369d4c8-b079-44ea-9b72-e9b7d32364fe tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:10.381292 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0369d4c8-b079-44ea-9b72-e9b7d32364fe tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:10.381906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0369d4c8-b079-44ea-9b72-e9b7d32364fe tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:10.382618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0369d4c8-b079-44ea-9b72-e9b7d32364fe tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:10.535293 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0369d4c8-b079-44ea-9b72-e9b7d32364fe tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:10.546065 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0369d4c8-b079-44ea-9b72-e9b7d32364fe tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:10.547635 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0369d4c8-b079-44ea-9b72-e9b7d32364fe tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:10.548895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0369d4c8-b079-44ea-9b72-e9b7d32364fe tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1739 microversion: 2.20 time: 0.182253 Sep 06 16:20:10.549697 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 305/625] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:10 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:11.577160 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f935aa65-cb56-483a-a04e-feb348eac6e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:11.577781 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f935aa65-cb56-483a-a04e-feb348eac6e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:11.585184 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f935aa65-cb56-483a-a04e-feb348eac6e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:11.585683 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f935aa65-cb56-483a-a04e-feb348eac6e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:11.586090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f935aa65-cb56-483a-a04e-feb348eac6e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:11.587926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f935aa65-cb56-483a-a04e-feb348eac6e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:11.588363 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f935aa65-cb56-483a-a04e-feb348eac6e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:11.588805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f935aa65-cb56-483a-a04e-feb348eac6e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:11.748798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f935aa65-cb56-483a-a04e-feb348eac6e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:11.760232 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f935aa65-cb56-483a-a04e-feb348eac6e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:11.762787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f935aa65-cb56-483a-a04e-feb348eac6e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:11.764175 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f935aa65-cb56-483a-a04e-feb348eac6e9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1739 microversion: 2.20 time: 0.191639 Sep 06 16:20:11.765499 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 321/626] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:11 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:12.792616 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-663de35e-08b2-45a1-a2c2-16af13875edc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:12.793888 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-663de35e-08b2-45a1-a2c2-16af13875edc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:12.800695 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-663de35e-08b2-45a1-a2c2-16af13875edc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:12.801213 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-663de35e-08b2-45a1-a2c2-16af13875edc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:12.801646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-663de35e-08b2-45a1-a2c2-16af13875edc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:12.802385 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-663de35e-08b2-45a1-a2c2-16af13875edc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:12.802834 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-663de35e-08b2-45a1-a2c2-16af13875edc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:12.803251 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-663de35e-08b2-45a1-a2c2-16af13875edc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:12.954215 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-663de35e-08b2-45a1-a2c2-16af13875edc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:12.963405 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-663de35e-08b2-45a1-a2c2-16af13875edc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:12.964864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-663de35e-08b2-45a1-a2c2-16af13875edc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:12.966054 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-663de35e-08b2-45a1-a2c2-16af13875edc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1739 microversion: 2.20 time: 0.179527 Sep 06 16:20:12.966590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 306/627] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:12 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:13.995135 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-cf4a80bd-cf16-4432-b7cb-ee1a633190a1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:13.997145 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-cf4a80bd-cf16-4432-b7cb-ee1a633190a1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:14.004210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cf4a80bd-cf16-4432-b7cb-ee1a633190a1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:14.004991 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cf4a80bd-cf16-4432-b7cb-ee1a633190a1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:14.005598 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cf4a80bd-cf16-4432-b7cb-ee1a633190a1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:14.006481 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cf4a80bd-cf16-4432-b7cb-ee1a633190a1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:14.006924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cf4a80bd-cf16-4432-b7cb-ee1a633190a1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:14.007337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cf4a80bd-cf16-4432-b7cb-ee1a633190a1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:14.167197 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cf4a80bd-cf16-4432-b7cb-ee1a633190a1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:14.181830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cf4a80bd-cf16-4432-b7cb-ee1a633190a1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:14.185720 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cf4a80bd-cf16-4432-b7cb-ee1a633190a1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:14.187487 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-cf4a80bd-cf16-4432-b7cb-ee1a633190a1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1739 microversion: 2.20 time: 0.199120 Sep 06 16:20:14.188804 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 322/628] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:13 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:15.214645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-52d2c49f-b6e3-425e-965b-4d6d8555a938 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:15.215179 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-52d2c49f-b6e3-425e-965b-4d6d8555a938 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:15.221837 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-52d2c49f-b6e3-425e-965b-4d6d8555a938 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:15.222315 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-52d2c49f-b6e3-425e-965b-4d6d8555a938 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:15.222939 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-52d2c49f-b6e3-425e-965b-4d6d8555a938 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:15.223639 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-52d2c49f-b6e3-425e-965b-4d6d8555a938 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:15.224084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-52d2c49f-b6e3-425e-965b-4d6d8555a938 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:15.224500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-52d2c49f-b6e3-425e-965b-4d6d8555a938 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:15.364323 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-52d2c49f-b6e3-425e-965b-4d6d8555a938 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:15.373995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-52d2c49f-b6e3-425e-965b-4d6d8555a938 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:15.375519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-52d2c49f-b6e3-425e-965b-4d6d8555a938 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:15.376882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-52d2c49f-b6e3-425e-965b-4d6d8555a938 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1739 microversion: 2.20 time: 0.166396 Sep 06 16:20:15.387064 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 307/629] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:15 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:16.403359 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-50406570-699c-48e8-a549-ed81ed307789 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:16.403935 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-50406570-699c-48e8-a549-ed81ed307789 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:16.410431 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-50406570-699c-48e8-a549-ed81ed307789 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:16.410906 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-50406570-699c-48e8-a549-ed81ed307789 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:16.411329 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-50406570-699c-48e8-a549-ed81ed307789 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:16.412054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-50406570-699c-48e8-a549-ed81ed307789 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:16.412491 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-50406570-699c-48e8-a549-ed81ed307789 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:16.412936 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-50406570-699c-48e8-a549-ed81ed307789 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:16.551946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-50406570-699c-48e8-a549-ed81ed307789 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:16.560556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-50406570-699c-48e8-a549-ed81ed307789 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:16.562006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-50406570-699c-48e8-a549-ed81ed307789 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:16.563145 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-50406570-699c-48e8-a549-ed81ed307789 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1739 microversion: 2.20 time: 0.163924 Sep 06 16:20:16.563664 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 323/630] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:16 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:20:17.589518 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-888c808e-ff42-4a6a-8b32-d9156975c73b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:17.590322 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-888c808e-ff42-4a6a-8b32-d9156975c73b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:17.610865 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-888c808e-ff42-4a6a-8b32-d9156975c73b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:17.611356 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-888c808e-ff42-4a6a-8b32-d9156975c73b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:17.611789 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-888c808e-ff42-4a6a-8b32-d9156975c73b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:17.612488 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-888c808e-ff42-4a6a-8b32-d9156975c73b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:17.612963 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-888c808e-ff42-4a6a-8b32-d9156975c73b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:17.613394 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-888c808e-ff42-4a6a-8b32-d9156975c73b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:17.795904 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-584d6d66-d1de-4a24-bbbb-83422a143a38 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:17.802867 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-584d6d66-d1de-4a24-bbbb-83422a143a38 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:17.803351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-584d6d66-d1de-4a24-bbbb-83422a143a38 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:17.803773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-584d6d66-d1de-4a24-bbbb-83422a143a38 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:17.831839 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:17.857044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-888c808e-ff42-4a6a-8b32-d9156975c73b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:17.866546 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-888c808e-ff42-4a6a-8b32-d9156975c73b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:17.867980 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-888c808e-ff42-4a6a-8b32-d9156975c73b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:17.868261 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-584d6d66-d1de-4a24-bbbb-83422a143a38 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Going to try to stop instance {{(pid=120668) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 16:20:17.869411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-888c808e-ff42-4a6a-8b32-d9156975c73b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1721 microversion: 2.20 time: 0.284079 Sep 06 16:20:17.869970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 308/631] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:17 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:17.916334 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-584d6d66-d1de-4a24-bbbb-83422a143a38 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "POST /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/action" status: 202 len: 0 microversion: 2.1 time: 0.124406 Sep 06 16:20:17.917620 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 324/632] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:20:17 2022] POST /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:20:17.928144 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-bba55872-a628-4021-9867-57df710b4a8f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:17.929809 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-bba55872-a628-4021-9867-57df710b4a8f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:17.938231 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bba55872-a628-4021-9867-57df710b4a8f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:17.939143 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bba55872-a628-4021-9867-57df710b4a8f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:17.939866 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bba55872-a628-4021-9867-57df710b4a8f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:17.940885 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bba55872-a628-4021-9867-57df710b4a8f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:17.942600 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bba55872-a628-4021-9867-57df710b4a8f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:17.943788 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bba55872-a628-4021-9867-57df710b4a8f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:18.118954 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-bba55872-a628-4021-9867-57df710b4a8f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:18.128072 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-bba55872-a628-4021-9867-57df710b4a8f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.204422 Sep 06 16:20:18.128657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 309/633] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:17 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:18.709151 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-90c05a56-d8c3-4c85-95c8-f81da450dc79 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13eca4ad-c51c-4690-99dc-1aadc055a4ff", "device": "/dev/sdb"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:18.712125 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-90c05a56-d8c3-4c85-95c8-f81da450dc79 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:18.719278 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90c05a56-d8c3-4c85-95c8-f81da450dc79 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:18.719497 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90c05a56-d8c3-4c85-95c8-f81da450dc79 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:18.719932 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90c05a56-d8c3-4c85-95c8-f81da450dc79 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:18.720634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90c05a56-d8c3-4c85-95c8-f81da450dc79 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:18.721089 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90c05a56-d8c3-4c85-95c8-f81da450dc79 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:18.721741 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-90c05a56-d8c3-4c85-95c8-f81da450dc79 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:18.901562 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5d00c3e8-737a-4a86-9548-c5f8f2898f71 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:18.902264 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5d00c3e8-737a-4a86-9548-c5f8f2898f71 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:18.908767 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5d00c3e8-737a-4a86-9548-c5f8f2898f71 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:18.909268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5d00c3e8-737a-4a86-9548-c5f8f2898f71 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:18.909693 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5d00c3e8-737a-4a86-9548-c5f8f2898f71 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:18.910418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5d00c3e8-737a-4a86-9548-c5f8f2898f71 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:18.910864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5d00c3e8-737a-4a86-9548-c5f8f2898f71 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:18.911277 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5d00c3e8-737a-4a86-9548-c5f8f2898f71 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:19.054531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5d00c3e8-737a-4a86-9548-c5f8f2898f71 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:19.063863 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5d00c3e8-737a-4a86-9548-c5f8f2898f71 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:19.065351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5d00c3e8-737a-4a86-9548-c5f8f2898f71 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:19.066524 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5d00c3e8-737a-4a86-9548-c5f8f2898f71 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1721 microversion: 2.20 time: 0.168941 Sep 06 16:20:19.067087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 310/634] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:18 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:19.152748 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-216a6ebc-da96-44b6-8fd0-c2d9f77c6060 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:19.153501 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-216a6ebc-da96-44b6-8fd0-c2d9f77c6060 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:19.163388 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-216a6ebc-da96-44b6-8fd0-c2d9f77c6060 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:19.164174 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-216a6ebc-da96-44b6-8fd0-c2d9f77c6060 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:19.164897 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-216a6ebc-da96-44b6-8fd0-c2d9f77c6060 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:19.165773 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-216a6ebc-da96-44b6-8fd0-c2d9f77c6060 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:19.166259 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-216a6ebc-da96-44b6-8fd0-c2d9f77c6060 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:19.166792 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-216a6ebc-da96-44b6-8fd0-c2d9f77c6060 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:19.311754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-216a6ebc-da96-44b6-8fd0-c2d9f77c6060 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:19.320336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-216a6ebc-da96-44b6-8fd0-c2d9f77c6060 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.172755 Sep 06 16:20:19.320940 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 311/635] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:19 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:20.092010 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-896acb86-d890-42de-8aa6-0856287f0eb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:20.092717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-896acb86-d890-42de-8aa6-0856287f0eb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:20.101603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-896acb86-d890-42de-8aa6-0856287f0eb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:20.102091 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-896acb86-d890-42de-8aa6-0856287f0eb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:20.102525 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-896acb86-d890-42de-8aa6-0856287f0eb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:20.103235 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-896acb86-d890-42de-8aa6-0856287f0eb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:20.103686 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-896acb86-d890-42de-8aa6-0856287f0eb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:20.104137 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-896acb86-d890-42de-8aa6-0856287f0eb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:20.253153 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-896acb86-d890-42de-8aa6-0856287f0eb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:20.267672 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-896acb86-d890-42de-8aa6-0856287f0eb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:20.270722 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-896acb86-d890-42de-8aa6-0856287f0eb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:20.272737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-896acb86-d890-42de-8aa6-0856287f0eb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1721 microversion: 2.20 time: 0.184450 Sep 06 16:20:20.274395 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 312/636] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:20 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:20.283870 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-9b06b00a-9702-47d7-bce9-c46ebd4c774a req-06d0a106-321c-4d0b-85d7-08e366fcd2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2", "name": "network-vif-unplugged", "status": "completed", "tag": "4b0a3d0f-c85a-40a8-b906-23e0735edd5e"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:20.295837 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-9b06b00a-9702-47d7-bce9-c46ebd4c774a req-06d0a106-321c-4d0b-85d7-08e366fcd2ae service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:20.296337 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-9b06b00a-9702-47d7-bce9-c46ebd4c774a req-06d0a106-321c-4d0b-85d7-08e366fcd2ae service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:20.296773 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-9b06b00a-9702-47d7-bce9-c46ebd4c774a req-06d0a106-321c-4d0b-85d7-08e366fcd2ae service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:20.309644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-9b06b00a-9702-47d7-bce9-c46ebd4c774a req-06d0a106-321c-4d0b-85d7-08e366fcd2ae service nova] Creating event network-vif-unplugged:4b0a3d0f-c85a-40a8-b906-23e0735edd5e for instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 on hv-cinder-85221 Sep 06 16:20:20.314844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-9b06b00a-9702-47d7-bce9-c46ebd4c774a req-06d0a106-321c-4d0b-85d7-08e366fcd2ae service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038659 Sep 06 16:20:20.315457 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 313/637] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:20.344478 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-76d42b6b-624d-45ba-862e-e748991afdd6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:20.345195 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-76d42b6b-624d-45ba-862e-e748991afdd6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:20.352741 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-76d42b6b-624d-45ba-862e-e748991afdd6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:20.353262 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-76d42b6b-624d-45ba-862e-e748991afdd6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:20.353690 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-76d42b6b-624d-45ba-862e-e748991afdd6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:20.354391 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-76d42b6b-624d-45ba-862e-e748991afdd6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:20.354838 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-76d42b6b-624d-45ba-862e-e748991afdd6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:20.355250 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-76d42b6b-624d-45ba-862e-e748991afdd6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:20.512247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-76d42b6b-624d-45ba-862e-e748991afdd6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:20.523985 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-76d42b6b-624d-45ba-862e-e748991afdd6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.183715 Sep 06 16:20:20.524579 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 314/638] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:20 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:20.818230 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-90c05a56-d8c3-4c85-95c8-f81da450dc79 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "POST /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.113356 Sep 06 16:20:20.819168 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 325/639] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:20:18 2022] POST /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba/os-volume_attachments => generated 194 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:21.303909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7f7a4eca-73d2-41f8-a211-5e5a8443c6ed tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:21.304543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7f7a4eca-73d2-41f8-a211-5e5a8443c6ed tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:21.311826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7f7a4eca-73d2-41f8-a211-5e5a8443c6ed tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:21.312279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7f7a4eca-73d2-41f8-a211-5e5a8443c6ed tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:21.312709 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7f7a4eca-73d2-41f8-a211-5e5a8443c6ed tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:21.313441 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7f7a4eca-73d2-41f8-a211-5e5a8443c6ed tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:21.313892 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7f7a4eca-73d2-41f8-a211-5e5a8443c6ed tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:21.314291 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7f7a4eca-73d2-41f8-a211-5e5a8443c6ed tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:21.467418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7f7a4eca-73d2-41f8-a211-5e5a8443c6ed tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:21.478243 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7f7a4eca-73d2-41f8-a211-5e5a8443c6ed tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:21.479675 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7f7a4eca-73d2-41f8-a211-5e5a8443c6ed tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:21.480978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7f7a4eca-73d2-41f8-a211-5e5a8443c6ed tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1724 microversion: 2.20 time: 0.181575 Sep 06 16:20:21.481770 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 315/640] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:21 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:21.507471 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e560d1cb-c219-4ac7-a999-62cf84708b8d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba276d4b-6c10-4e81-96bf-c8dea6ee0e4e"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:21.510034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e560d1cb-c219-4ac7-a999-62cf84708b8d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:21.517593 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e560d1cb-c219-4ac7-a999-62cf84708b8d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:21.518263 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e560d1cb-c219-4ac7-a999-62cf84708b8d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:21.518795 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e560d1cb-c219-4ac7-a999-62cf84708b8d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:21.519641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e560d1cb-c219-4ac7-a999-62cf84708b8d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:21.520188 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e560d1cb-c219-4ac7-a999-62cf84708b8d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:21.520634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e560d1cb-c219-4ac7-a999-62cf84708b8d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:21.548251 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c52896fe-34d6-4daa-a074-9f755828c53e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:21.548790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c52896fe-34d6-4daa-a074-9f755828c53e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:21.557327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c52896fe-34d6-4daa-a074-9f755828c53e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:21.557831 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c52896fe-34d6-4daa-a074-9f755828c53e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:21.558784 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c52896fe-34d6-4daa-a074-9f755828c53e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:21.559511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c52896fe-34d6-4daa-a074-9f755828c53e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:21.559965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c52896fe-34d6-4daa-a074-9f755828c53e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:21.560380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c52896fe-34d6-4daa-a074-9f755828c53e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:21.716812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c52896fe-34d6-4daa-a074-9f755828c53e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:21.725605 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c52896fe-34d6-4daa-a074-9f755828c53e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.181319 Sep 06 16:20:21.726185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 316/641] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:21 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:21.833816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e560d1cb-c219-4ac7-a999-62cf84708b8d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "POST /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.331136 Sep 06 16:20:21.835117 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 326/642] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Sep 6 16:20:21 2022] POST /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments => generated 188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:20:22.003386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-07903cc8-97e5-4b73-b32c-003ba195ec20 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:22.003974 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-07903cc8-97e5-4b73-b32c-003ba195ec20 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:22.010243 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07903cc8-97e5-4b73-b32c-003ba195ec20 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.010782 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07903cc8-97e5-4b73-b32c-003ba195ec20 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.011192 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07903cc8-97e5-4b73-b32c-003ba195ec20 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.011815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07903cc8-97e5-4b73-b32c-003ba195ec20 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.012275 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07903cc8-97e5-4b73-b32c-003ba195ec20 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.012690 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07903cc8-97e5-4b73-b32c-003ba195ec20 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.059159 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-07903cc8-97e5-4b73-b32c-003ba195ec20 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120669) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 16:20:22.133850 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-07903cc8-97e5-4b73-b32c-003ba195ec20 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "POST /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/action" status: 202 len: 0 microversion: 2.20 time: 0.134193 Sep 06 16:20:22.134845 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 317/643] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Sep 6 16:20:21 2022] POST /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:20:22.143900 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-48a30812-28f3-4c4d-83f5-cda29428f7ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:22.144510 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-48a30812-28f3-4c4d-83f5-cda29428f7ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:22.154579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-48a30812-28f3-4c4d-83f5-cda29428f7ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.155079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-48a30812-28f3-4c4d-83f5-cda29428f7ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.155656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-48a30812-28f3-4c4d-83f5-cda29428f7ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.156369 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-48a30812-28f3-4c4d-83f5-cda29428f7ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.156986 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-48a30812-28f3-4c4d-83f5-cda29428f7ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.157414 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-48a30812-28f3-4c4d-83f5-cda29428f7ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.349195 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-48a30812-28f3-4c4d-83f5-cda29428f7ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:22.358188 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-48a30812-28f3-4c4d-83f5-cda29428f7ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:22.359880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-48a30812-28f3-4c4d-83f5-cda29428f7ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:22.361354 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-48a30812-28f3-4c4d-83f5-cda29428f7ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1750 microversion: 2.20 time: 0.221786 Sep 06 16:20:22.362023 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 327/644] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:22 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1750 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:20:22.750301 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-591f93c7-3e7e-4a9c-9f93-ec0337db7ec8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:22.751013 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-591f93c7-3e7e-4a9c-9f93-ec0337db7ec8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:22.757434 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-591f93c7-3e7e-4a9c-9f93-ec0337db7ec8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.758007 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-591f93c7-3e7e-4a9c-9f93-ec0337db7ec8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.758508 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-591f93c7-3e7e-4a9c-9f93-ec0337db7ec8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.759444 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-591f93c7-3e7e-4a9c-9f93-ec0337db7ec8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.759983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-591f93c7-3e7e-4a9c-9f93-ec0337db7ec8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.760475 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-591f93c7-3e7e-4a9c-9f93-ec0337db7ec8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.918845 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-591f93c7-3e7e-4a9c-9f93-ec0337db7ec8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:22.930426 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-591f93c7-3e7e-4a9c-9f93-ec0337db7ec8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.184859 Sep 06 16:20:22.931336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 318/645] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:22 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:23.388211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e2cefdb6-9043-4f0a-92ab-84ef7578618f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:23.388821 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e2cefdb6-9043-4f0a-92ab-84ef7578618f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:23.396256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e2cefdb6-9043-4f0a-92ab-84ef7578618f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:23.396745 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e2cefdb6-9043-4f0a-92ab-84ef7578618f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:23.397234 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e2cefdb6-9043-4f0a-92ab-84ef7578618f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:23.397936 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e2cefdb6-9043-4f0a-92ab-84ef7578618f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:23.398381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e2cefdb6-9043-4f0a-92ab-84ef7578618f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:23.398801 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e2cefdb6-9043-4f0a-92ab-84ef7578618f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:23.552981 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e2cefdb6-9043-4f0a-92ab-84ef7578618f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:23.562626 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e2cefdb6-9043-4f0a-92ab-84ef7578618f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:23.564044 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e2cefdb6-9043-4f0a-92ab-84ef7578618f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:23.565297 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e2cefdb6-9043-4f0a-92ab-84ef7578618f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1750 microversion: 2.20 time: 0.181438 Sep 06 16:20:23.566617 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 328/646] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:23 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:23.956348 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b5bd680c-9c74-4200-b0a7-8f23c39959dc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:23.956973 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b5bd680c-9c74-4200-b0a7-8f23c39959dc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:23.968316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b5bd680c-9c74-4200-b0a7-8f23c39959dc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:23.968791 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b5bd680c-9c74-4200-b0a7-8f23c39959dc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:23.969255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b5bd680c-9c74-4200-b0a7-8f23c39959dc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:23.970049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b5bd680c-9c74-4200-b0a7-8f23c39959dc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:23.970497 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b5bd680c-9c74-4200-b0a7-8f23c39959dc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:23.971080 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b5bd680c-9c74-4200-b0a7-8f23c39959dc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:24.132627 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b5bd680c-9c74-4200-b0a7-8f23c39959dc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:24.146320 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b5bd680c-9c74-4200-b0a7-8f23c39959dc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.194320 Sep 06 16:20:24.147220 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 319/647] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:23 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:24.596339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9ff33710-06ee-454d-8336-970bb3048770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:24.596339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9ff33710-06ee-454d-8336-970bb3048770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:24.603751 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9ff33710-06ee-454d-8336-970bb3048770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:24.604237 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9ff33710-06ee-454d-8336-970bb3048770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:24.604658 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9ff33710-06ee-454d-8336-970bb3048770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:24.605378 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9ff33710-06ee-454d-8336-970bb3048770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:24.605821 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9ff33710-06ee-454d-8336-970bb3048770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:24.606234 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9ff33710-06ee-454d-8336-970bb3048770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:24.753257 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9ff33710-06ee-454d-8336-970bb3048770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:24.762428 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9ff33710-06ee-454d-8336-970bb3048770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:24.763872 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9ff33710-06ee-454d-8336-970bb3048770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:24.765117 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9ff33710-06ee-454d-8336-970bb3048770 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1752 microversion: 2.20 time: 0.175191 Sep 06 16:20:24.765877 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 329/648] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:24 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:25.170434 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-846a39b4-deec-4087-88b5-b00e701ce6a5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:25.171126 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-846a39b4-deec-4087-88b5-b00e701ce6a5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:25.178803 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-846a39b4-deec-4087-88b5-b00e701ce6a5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:25.179299 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-846a39b4-deec-4087-88b5-b00e701ce6a5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:25.179734 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-846a39b4-deec-4087-88b5-b00e701ce6a5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:25.181591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-846a39b4-deec-4087-88b5-b00e701ce6a5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:25.181591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-846a39b4-deec-4087-88b5-b00e701ce6a5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:25.181591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-846a39b4-deec-4087-88b5-b00e701ce6a5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:25.213952 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:25.372118 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-846a39b4-deec-4087-88b5-b00e701ce6a5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:25.383557 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-846a39b4-deec-4087-88b5-b00e701ce6a5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.217526 Sep 06 16:20:25.384140 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 320/649] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:25 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:25.790599 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2b263213-0207-459a-9f83-c0afd13fcc0b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:25.791736 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2b263213-0207-459a-9f83-c0afd13fcc0b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:25.804780 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b263213-0207-459a-9f83-c0afd13fcc0b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:25.805529 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b263213-0207-459a-9f83-c0afd13fcc0b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:25.806268 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b263213-0207-459a-9f83-c0afd13fcc0b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:25.807397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b263213-0207-459a-9f83-c0afd13fcc0b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:25.808162 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b263213-0207-459a-9f83-c0afd13fcc0b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:25.809128 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b263213-0207-459a-9f83-c0afd13fcc0b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:25.973531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2b263213-0207-459a-9f83-c0afd13fcc0b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:25.983342 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2b263213-0207-459a-9f83-c0afd13fcc0b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:25.984741 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2b263213-0207-459a-9f83-c0afd13fcc0b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:25.985979 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2b263213-0207-459a-9f83-c0afd13fcc0b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1752 microversion: 2.20 time: 0.199316 Sep 06 16:20:25.986474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 330/650] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:25 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1752 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:26.407303 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-24fde9c4-4cb9-4eac-9359-139fdbcc1906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:26.407878 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-24fde9c4-4cb9-4eac-9359-139fdbcc1906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:26.414770 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24fde9c4-4cb9-4eac-9359-139fdbcc1906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:26.415230 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24fde9c4-4cb9-4eac-9359-139fdbcc1906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:26.415671 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24fde9c4-4cb9-4eac-9359-139fdbcc1906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:26.416348 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24fde9c4-4cb9-4eac-9359-139fdbcc1906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:26.416825 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24fde9c4-4cb9-4eac-9359-139fdbcc1906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:26.417238 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24fde9c4-4cb9-4eac-9359-139fdbcc1906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:26.549407 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-24fde9c4-4cb9-4eac-9359-139fdbcc1906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:26.558000 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-24fde9c4-4cb9-4eac-9359-139fdbcc1906 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.154579 Sep 06 16:20:26.558945 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 321/651] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:26 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:27.011688 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c701f15d-cad1-4dc8-b676-2da6374c8e22 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:27.012295 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c701f15d-cad1-4dc8-b676-2da6374c8e22 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:27.018999 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c701f15d-cad1-4dc8-b676-2da6374c8e22 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:27.019524 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c701f15d-cad1-4dc8-b676-2da6374c8e22 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:27.019923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c701f15d-cad1-4dc8-b676-2da6374c8e22 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:27.020624 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c701f15d-cad1-4dc8-b676-2da6374c8e22 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:27.021112 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c701f15d-cad1-4dc8-b676-2da6374c8e22 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:27.021536 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c701f15d-cad1-4dc8-b676-2da6374c8e22 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:27.179598 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c701f15d-cad1-4dc8-b676-2da6374c8e22 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:27.189398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c701f15d-cad1-4dc8-b676-2da6374c8e22 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:27.190816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c701f15d-cad1-4dc8-b676-2da6374c8e22 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:27.191975 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c701f15d-cad1-4dc8-b676-2da6374c8e22 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1752 microversion: 2.20 time: 0.185215 Sep 06 16:20:27.192520 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 331/652] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:27 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:27.584914 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c6d65425-bb09-4e04-9bbc-3408cff34c65 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:27.585497 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c6d65425-bb09-4e04-9bbc-3408cff34c65 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:27.592511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c6d65425-bb09-4e04-9bbc-3408cff34c65 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:27.593041 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c6d65425-bb09-4e04-9bbc-3408cff34c65 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:27.593493 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c6d65425-bb09-4e04-9bbc-3408cff34c65 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:27.594177 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c6d65425-bb09-4e04-9bbc-3408cff34c65 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:27.594626 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c6d65425-bb09-4e04-9bbc-3408cff34c65 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:27.595046 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c6d65425-bb09-4e04-9bbc-3408cff34c65 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:27.734613 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c6d65425-bb09-4e04-9bbc-3408cff34c65 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:27.743661 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c6d65425-bb09-4e04-9bbc-3408cff34c65 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.162814 Sep 06 16:20:27.744245 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 322/653] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:27 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:28.220334 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a1ca129b-6a30-42bc-826b-65fb817166c2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:28.220967 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a1ca129b-6a30-42bc-826b-65fb817166c2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:28.229092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a1ca129b-6a30-42bc-826b-65fb817166c2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:28.229586 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a1ca129b-6a30-42bc-826b-65fb817166c2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:28.230015 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a1ca129b-6a30-42bc-826b-65fb817166c2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:28.230705 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a1ca129b-6a30-42bc-826b-65fb817166c2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:28.231153 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a1ca129b-6a30-42bc-826b-65fb817166c2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:28.231573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a1ca129b-6a30-42bc-826b-65fb817166c2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:28.394006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a1ca129b-6a30-42bc-826b-65fb817166c2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:28.403249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a1ca129b-6a30-42bc-826b-65fb817166c2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:28.404776 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a1ca129b-6a30-42bc-826b-65fb817166c2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:28.405944 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a1ca129b-6a30-42bc-826b-65fb817166c2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1752 microversion: 2.20 time: 0.191728 Sep 06 16:20:28.406497 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 332/654] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:28 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1752 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:28.768592 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ba0c44dc-b5d9-4018-8454-7de8effdf419 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:28.769321 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ba0c44dc-b5d9-4018-8454-7de8effdf419 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:28.776864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba0c44dc-b5d9-4018-8454-7de8effdf419 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:28.777347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba0c44dc-b5d9-4018-8454-7de8effdf419 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:28.777775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba0c44dc-b5d9-4018-8454-7de8effdf419 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:28.778468 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba0c44dc-b5d9-4018-8454-7de8effdf419 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:28.778938 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba0c44dc-b5d9-4018-8454-7de8effdf419 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:28.779351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba0c44dc-b5d9-4018-8454-7de8effdf419 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:28.927189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ba0c44dc-b5d9-4018-8454-7de8effdf419 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:28.937491 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ba0c44dc-b5d9-4018-8454-7de8effdf419 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.173867 Sep 06 16:20:28.938062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 323/655] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:28 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:29.432432 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2a222147-978c-4268-8445-c6fffd50b33c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:29.434273 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2a222147-978c-4268-8445-c6fffd50b33c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:29.442421 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2a222147-978c-4268-8445-c6fffd50b33c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:29.443504 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2a222147-978c-4268-8445-c6fffd50b33c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:29.444144 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2a222147-978c-4268-8445-c6fffd50b33c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:29.445032 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2a222147-978c-4268-8445-c6fffd50b33c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:29.445398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2a222147-978c-4268-8445-c6fffd50b33c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:29.445822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2a222147-978c-4268-8445-c6fffd50b33c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:29.596123 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2a222147-978c-4268-8445-c6fffd50b33c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:29.610576 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2a222147-978c-4268-8445-c6fffd50b33c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:29.612177 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2a222147-978c-4268-8445-c6fffd50b33c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:29.613313 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2a222147-978c-4268-8445-c6fffd50b33c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1752 microversion: 2.20 time: 0.186253 Sep 06 16:20:29.613885 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 333/656] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:29 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:29.962903 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8eb51fa2-07d2-4035-b2f6-cf604da75d9e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:29.963657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8eb51fa2-07d2-4035-b2f6-cf604da75d9e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:29.974003 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8eb51fa2-07d2-4035-b2f6-cf604da75d9e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:29.974515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8eb51fa2-07d2-4035-b2f6-cf604da75d9e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:29.975080 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8eb51fa2-07d2-4035-b2f6-cf604da75d9e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:29.975703 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8eb51fa2-07d2-4035-b2f6-cf604da75d9e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:29.976161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8eb51fa2-07d2-4035-b2f6-cf604da75d9e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:29.976576 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8eb51fa2-07d2-4035-b2f6-cf604da75d9e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:30.114895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8eb51fa2-07d2-4035-b2f6-cf604da75d9e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:30.124134 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8eb51fa2-07d2-4035-b2f6-cf604da75d9e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.165513 Sep 06 16:20:30.124708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 324/657] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:29 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:30.645761 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-dab00975-8f73-44f8-aa88-751637bb2bb1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:30.646564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-dab00975-8f73-44f8-aa88-751637bb2bb1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:30.656534 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dab00975-8f73-44f8-aa88-751637bb2bb1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:30.657140 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dab00975-8f73-44f8-aa88-751637bb2bb1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:30.657572 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dab00975-8f73-44f8-aa88-751637bb2bb1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:30.658287 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dab00975-8f73-44f8-aa88-751637bb2bb1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:30.658753 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dab00975-8f73-44f8-aa88-751637bb2bb1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:30.659169 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dab00975-8f73-44f8-aa88-751637bb2bb1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:30.827271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dab00975-8f73-44f8-aa88-751637bb2bb1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:30.837145 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dab00975-8f73-44f8-aa88-751637bb2bb1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:30.839107 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dab00975-8f73-44f8-aa88-751637bb2bb1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:30.840569 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-dab00975-8f73-44f8-aa88-751637bb2bb1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.198790 Sep 06 16:20:30.841338 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 334/658] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:30 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:31.149348 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d131b328-479a-44ed-a6dc-56d13bd556e5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:31.150327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d131b328-479a-44ed-a6dc-56d13bd556e5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:31.153248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:31.158861 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d131b328-479a-44ed-a6dc-56d13bd556e5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:31.159345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d131b328-479a-44ed-a6dc-56d13bd556e5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:31.159798 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d131b328-479a-44ed-a6dc-56d13bd556e5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:31.160478 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d131b328-479a-44ed-a6dc-56d13bd556e5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:31.160982 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d131b328-479a-44ed-a6dc-56d13bd556e5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:31.161518 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d131b328-479a-44ed-a6dc-56d13bd556e5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:31.314442 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d131b328-479a-44ed-a6dc-56d13bd556e5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:31.326892 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d131b328-479a-44ed-a6dc-56d13bd556e5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.181119 Sep 06 16:20:31.327647 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 325/659] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:31 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:31.870379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-72380c9e-9d1c-4170-a957-dab703b26444 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:31.871013 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-72380c9e-9d1c-4170-a957-dab703b26444 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:31.878234 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-72380c9e-9d1c-4170-a957-dab703b26444 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:31.878835 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-72380c9e-9d1c-4170-a957-dab703b26444 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:31.879290 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-72380c9e-9d1c-4170-a957-dab703b26444 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:31.880071 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-72380c9e-9d1c-4170-a957-dab703b26444 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:31.880577 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-72380c9e-9d1c-4170-a957-dab703b26444 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:31.881057 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-72380c9e-9d1c-4170-a957-dab703b26444 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:32.021420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-72380c9e-9d1c-4170-a957-dab703b26444 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:32.025077 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:32.031863 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-72380c9e-9d1c-4170-a957-dab703b26444 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:32.033327 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-72380c9e-9d1c-4170-a957-dab703b26444 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:32.034522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-72380c9e-9d1c-4170-a957-dab703b26444 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.168190 Sep 06 16:20:32.035082 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 335/660] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:31 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:32.351668 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4b76ea05-9dcd-4ec6-83ae-7b70217ff95a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:32.352247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4b76ea05-9dcd-4ec6-83ae-7b70217ff95a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:32.359248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b76ea05-9dcd-4ec6-83ae-7b70217ff95a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:32.359733 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b76ea05-9dcd-4ec6-83ae-7b70217ff95a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:32.360161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b76ea05-9dcd-4ec6-83ae-7b70217ff95a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:32.360884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b76ea05-9dcd-4ec6-83ae-7b70217ff95a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:32.361370 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b76ea05-9dcd-4ec6-83ae-7b70217ff95a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:32.361783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4b76ea05-9dcd-4ec6-83ae-7b70217ff95a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:32.496139 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4b76ea05-9dcd-4ec6-83ae-7b70217ff95a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:32.504743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4b76ea05-9dcd-4ec6-83ae-7b70217ff95a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.156976 Sep 06 16:20:32.505406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 326/661] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:32 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:33.065436 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b9e75b4a-49b7-425a-9f08-baf670faf4e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:33.066377 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b9e75b4a-49b7-425a-9f08-baf670faf4e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:33.075012 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b9e75b4a-49b7-425a-9f08-baf670faf4e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:33.075495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b9e75b4a-49b7-425a-9f08-baf670faf4e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:33.075918 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b9e75b4a-49b7-425a-9f08-baf670faf4e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:33.076617 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b9e75b4a-49b7-425a-9f08-baf670faf4e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:33.077096 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b9e75b4a-49b7-425a-9f08-baf670faf4e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:33.077517 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b9e75b4a-49b7-425a-9f08-baf670faf4e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:33.215843 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b9e75b4a-49b7-425a-9f08-baf670faf4e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:33.225259 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b9e75b4a-49b7-425a-9f08-baf670faf4e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:33.226787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b9e75b4a-49b7-425a-9f08-baf670faf4e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:33.227949 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b9e75b4a-49b7-425a-9f08-baf670faf4e0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.169935 Sep 06 16:20:33.228510 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 336/662] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:33 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:33.529571 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-34f8df70-538d-4b9a-81e4-ed295de6aef4 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:33.530302 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-34f8df70-538d-4b9a-81e4-ed295de6aef4 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:33.537109 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-34f8df70-538d-4b9a-81e4-ed295de6aef4 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:33.537581 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-34f8df70-538d-4b9a-81e4-ed295de6aef4 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:33.537996 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-34f8df70-538d-4b9a-81e4-ed295de6aef4 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:33.538689 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-34f8df70-538d-4b9a-81e4-ed295de6aef4 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:33.539123 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-34f8df70-538d-4b9a-81e4-ed295de6aef4 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:33.539555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-34f8df70-538d-4b9a-81e4-ed295de6aef4 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:33.683758 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-34f8df70-538d-4b9a-81e4-ed295de6aef4 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:33.692504 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-34f8df70-538d-4b9a-81e4-ed295de6aef4 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.166878 Sep 06 16:20:33.693144 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 327/663] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:33 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:34.258400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f812bf20-b99d-4bd8-b431-ab2a2bdd3560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:34.259050 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f812bf20-b99d-4bd8-b431-ab2a2bdd3560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:34.265749 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f812bf20-b99d-4bd8-b431-ab2a2bdd3560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:34.266222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f812bf20-b99d-4bd8-b431-ab2a2bdd3560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:34.266647 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f812bf20-b99d-4bd8-b431-ab2a2bdd3560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:34.267326 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f812bf20-b99d-4bd8-b431-ab2a2bdd3560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:34.267770 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f812bf20-b99d-4bd8-b431-ab2a2bdd3560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:34.268179 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f812bf20-b99d-4bd8-b431-ab2a2bdd3560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:34.399794 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f812bf20-b99d-4bd8-b431-ab2a2bdd3560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:34.408781 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f812bf20-b99d-4bd8-b431-ab2a2bdd3560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:34.410203 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f812bf20-b99d-4bd8-b431-ab2a2bdd3560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:34.411363 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f812bf20-b99d-4bd8-b431-ab2a2bdd3560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.156914 Sep 06 16:20:34.411888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 337/664] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:34 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:20:34.716511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3b578cb5-f122-4e08-a3c0-2eeb99117fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:34.717093 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-3b578cb5-f122-4e08-a3c0-2eeb99117fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:34.723957 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3b578cb5-f122-4e08-a3c0-2eeb99117fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:34.724447 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3b578cb5-f122-4e08-a3c0-2eeb99117fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:34.724916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3b578cb5-f122-4e08-a3c0-2eeb99117fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:34.725616 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3b578cb5-f122-4e08-a3c0-2eeb99117fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:34.726069 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3b578cb5-f122-4e08-a3c0-2eeb99117fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:34.726771 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3b578cb5-f122-4e08-a3c0-2eeb99117fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:34.866314 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3b578cb5-f122-4e08-a3c0-2eeb99117fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:34.875492 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-3b578cb5-f122-4e08-a3c0-2eeb99117fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.163069 Sep 06 16:20:34.876163 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 328/665] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:34 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:35.436744 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b2c7b01d-c7cf-470e-bf06-39312381134a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:35.437403 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b2c7b01d-c7cf-470e-bf06-39312381134a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:35.444862 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2c7b01d-c7cf-470e-bf06-39312381134a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:35.445362 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2c7b01d-c7cf-470e-bf06-39312381134a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:35.445848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2c7b01d-c7cf-470e-bf06-39312381134a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:35.446556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2c7b01d-c7cf-470e-bf06-39312381134a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:35.447004 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2c7b01d-c7cf-470e-bf06-39312381134a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:35.447425 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2c7b01d-c7cf-470e-bf06-39312381134a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:35.601826 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b2c7b01d-c7cf-470e-bf06-39312381134a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:35.617484 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b2c7b01d-c7cf-470e-bf06-39312381134a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:35.618964 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b2c7b01d-c7cf-470e-bf06-39312381134a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:35.620280 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b2c7b01d-c7cf-470e-bf06-39312381134a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.188082 Sep 06 16:20:35.620889 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 338/666] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:35 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:35.899310 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5355ecc0-996e-403b-81a9-25b177250917 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:35.899984 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5355ecc0-996e-403b-81a9-25b177250917 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:35.907173 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5355ecc0-996e-403b-81a9-25b177250917 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:35.907667 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5355ecc0-996e-403b-81a9-25b177250917 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:35.908124 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5355ecc0-996e-403b-81a9-25b177250917 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:35.908829 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5355ecc0-996e-403b-81a9-25b177250917 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:35.909271 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5355ecc0-996e-403b-81a9-25b177250917 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:35.909683 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5355ecc0-996e-403b-81a9-25b177250917 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:36.044378 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5355ecc0-996e-403b-81a9-25b177250917 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:36.052784 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5355ecc0-996e-403b-81a9-25b177250917 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.157581 Sep 06 16:20:36.053330 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 329/667] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:35 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:36.654356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5c76829a-7557-44be-b59d-26077b953dbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:36.654953 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5c76829a-7557-44be-b59d-26077b953dbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:36.661735 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5c76829a-7557-44be-b59d-26077b953dbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:36.662222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5c76829a-7557-44be-b59d-26077b953dbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:36.662664 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5c76829a-7557-44be-b59d-26077b953dbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:36.663383 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5c76829a-7557-44be-b59d-26077b953dbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:36.663814 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5c76829a-7557-44be-b59d-26077b953dbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:36.664366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5c76829a-7557-44be-b59d-26077b953dbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:36.800945 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5c76829a-7557-44be-b59d-26077b953dbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:36.810922 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5c76829a-7557-44be-b59d-26077b953dbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:36.812478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5c76829a-7557-44be-b59d-26077b953dbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:36.814016 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5c76829a-7557-44be-b59d-26077b953dbf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.163637 Sep 06 16:20:36.814627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 339/668] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:36 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:37.075780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c49bb4e1-d1fd-479b-90c0-2bb252ea7010 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:37.076397 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c49bb4e1-d1fd-479b-90c0-2bb252ea7010 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:37.083396 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c49bb4e1-d1fd-479b-90c0-2bb252ea7010 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:37.083872 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c49bb4e1-d1fd-479b-90c0-2bb252ea7010 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:37.084301 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c49bb4e1-d1fd-479b-90c0-2bb252ea7010 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:37.085023 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c49bb4e1-d1fd-479b-90c0-2bb252ea7010 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:37.085466 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c49bb4e1-d1fd-479b-90c0-2bb252ea7010 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:37.085858 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c49bb4e1-d1fd-479b-90c0-2bb252ea7010 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:37.267287 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c49bb4e1-d1fd-479b-90c0-2bb252ea7010 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:37.276628 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c49bb4e1-d1fd-479b-90c0-2bb252ea7010 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.204661 Sep 06 16:20:37.277254 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 330/669] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:37 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:37.840819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-bbec72a9-b2e9-43ed-910b-58748e5b3a51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:37.841571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-bbec72a9-b2e9-43ed-910b-58748e5b3a51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:37.848589 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bbec72a9-b2e9-43ed-910b-58748e5b3a51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:37.849107 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bbec72a9-b2e9-43ed-910b-58748e5b3a51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:37.849566 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bbec72a9-b2e9-43ed-910b-58748e5b3a51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:37.850264 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bbec72a9-b2e9-43ed-910b-58748e5b3a51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:37.850712 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bbec72a9-b2e9-43ed-910b-58748e5b3a51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:37.851128 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bbec72a9-b2e9-43ed-910b-58748e5b3a51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:37.987603 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-bbec72a9-b2e9-43ed-910b-58748e5b3a51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:37.996990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-bbec72a9-b2e9-43ed-910b-58748e5b3a51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:37.998437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-bbec72a9-b2e9-43ed-910b-58748e5b3a51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:37.999591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-bbec72a9-b2e9-43ed-910b-58748e5b3a51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.162842 Sep 06 16:20:38.000172 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 340/670] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:37 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:38.300708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-df18bc67-c8b6-431e-9f16-398259b568a3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:38.301442 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-df18bc67-c8b6-431e-9f16-398259b568a3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:38.310387 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df18bc67-c8b6-431e-9f16-398259b568a3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:38.310910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df18bc67-c8b6-431e-9f16-398259b568a3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:38.311353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df18bc67-c8b6-431e-9f16-398259b568a3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:38.312081 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df18bc67-c8b6-431e-9f16-398259b568a3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:38.312513 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df18bc67-c8b6-431e-9f16-398259b568a3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:38.312976 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df18bc67-c8b6-431e-9f16-398259b568a3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:38.460024 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-df18bc67-c8b6-431e-9f16-398259b568a3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:38.477829 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-df18bc67-c8b6-431e-9f16-398259b568a3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.181208 Sep 06 16:20:38.478705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 331/671] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:38 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:39.025465 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-be083020-7d28-4ab4-a90c-0d4db56f3999 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:39.026045 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-be083020-7d28-4ab4-a90c-0d4db56f3999 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:39.032959 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-be083020-7d28-4ab4-a90c-0d4db56f3999 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:39.033448 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-be083020-7d28-4ab4-a90c-0d4db56f3999 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:39.033878 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-be083020-7d28-4ab4-a90c-0d4db56f3999 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:39.034579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-be083020-7d28-4ab4-a90c-0d4db56f3999 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:39.035024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-be083020-7d28-4ab4-a90c-0d4db56f3999 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:39.035438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-be083020-7d28-4ab4-a90c-0d4db56f3999 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:39.180346 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-be083020-7d28-4ab4-a90c-0d4db56f3999 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:39.190920 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-be083020-7d28-4ab4-a90c-0d4db56f3999 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:39.192364 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-be083020-7d28-4ab4-a90c-0d4db56f3999 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:39.193582 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-be083020-7d28-4ab4-a90c-0d4db56f3999 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.172087 Sep 06 16:20:39.194723 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 341/672] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:39 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:39.502339 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-67bf7942-7f7d-4cae-bbd8-6dbbe56f6f0e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:39.502893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-67bf7942-7f7d-4cae-bbd8-6dbbe56f6f0e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:39.509826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67bf7942-7f7d-4cae-bbd8-6dbbe56f6f0e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:39.510309 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67bf7942-7f7d-4cae-bbd8-6dbbe56f6f0e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:39.510741 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67bf7942-7f7d-4cae-bbd8-6dbbe56f6f0e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:39.511487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67bf7942-7f7d-4cae-bbd8-6dbbe56f6f0e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:39.511904 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67bf7942-7f7d-4cae-bbd8-6dbbe56f6f0e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:39.512322 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67bf7942-7f7d-4cae-bbd8-6dbbe56f6f0e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:39.736419 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-67bf7942-7f7d-4cae-bbd8-6dbbe56f6f0e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:39.747892 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-67bf7942-7f7d-4cae-bbd8-6dbbe56f6f0e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.249386 Sep 06 16:20:39.748466 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 332/673] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:39 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:40.219731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-8ae85298-62eb-4e5b-a84b-e27e717d72d5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:40.220341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-8ae85298-62eb-4e5b-a84b-e27e717d72d5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:40.222811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=44 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:40.228576 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8ae85298-62eb-4e5b-a84b-e27e717d72d5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:40.229350 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8ae85298-62eb-4e5b-a84b-e27e717d72d5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:40.229788 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8ae85298-62eb-4e5b-a84b-e27e717d72d5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:40.230485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8ae85298-62eb-4e5b-a84b-e27e717d72d5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:40.230932 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8ae85298-62eb-4e5b-a84b-e27e717d72d5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:40.231349 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8ae85298-62eb-4e5b-a84b-e27e717d72d5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:40.368044 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8ae85298-62eb-4e5b-a84b-e27e717d72d5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:40.378565 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8ae85298-62eb-4e5b-a84b-e27e717d72d5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:40.380001 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8ae85298-62eb-4e5b-a84b-e27e717d72d5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:40.381259 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-8ae85298-62eb-4e5b-a84b-e27e717d72d5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.165423 Sep 06 16:20:40.381749 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 342/674] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:40 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:40.771429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-99132bfe-7c1c-4291-a9db-59eb0658ba60 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:40.772008 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-99132bfe-7c1c-4291-a9db-59eb0658ba60 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:40.785531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99132bfe-7c1c-4291-a9db-59eb0658ba60 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:40.786280 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99132bfe-7c1c-4291-a9db-59eb0658ba60 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:40.787159 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99132bfe-7c1c-4291-a9db-59eb0658ba60 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:40.788322 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99132bfe-7c1c-4291-a9db-59eb0658ba60 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:40.789119 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99132bfe-7c1c-4291-a9db-59eb0658ba60 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:40.789809 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99132bfe-7c1c-4291-a9db-59eb0658ba60 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:40.935478 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-99132bfe-7c1c-4291-a9db-59eb0658ba60 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:40.944709 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-99132bfe-7c1c-4291-a9db-59eb0658ba60 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.177272 Sep 06 16:20:40.945337 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 333/675] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:40 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:41.409670 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ed87d2de-904e-4964-98ce-aaa7254cdb67 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:41.410290 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ed87d2de-904e-4964-98ce-aaa7254cdb67 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:41.417569 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed87d2de-904e-4964-98ce-aaa7254cdb67 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:41.418459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed87d2de-904e-4964-98ce-aaa7254cdb67 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:41.419214 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed87d2de-904e-4964-98ce-aaa7254cdb67 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:41.419967 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed87d2de-904e-4964-98ce-aaa7254cdb67 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:41.420443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed87d2de-904e-4964-98ce-aaa7254cdb67 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:41.420895 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed87d2de-904e-4964-98ce-aaa7254cdb67 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:41.561393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ed87d2de-904e-4964-98ce-aaa7254cdb67 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:41.570189 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ed87d2de-904e-4964-98ce-aaa7254cdb67 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:41.571595 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ed87d2de-904e-4964-98ce-aaa7254cdb67 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:41.572900 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ed87d2de-904e-4964-98ce-aaa7254cdb67 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.167071 Sep 06 16:20:41.573458 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 343/676] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:41 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:20:41.967868 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8f3c8d0f-b74d-41e3-a48b-b4b76394a822 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:41.968487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8f3c8d0f-b74d-41e3-a48b-b4b76394a822 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:41.975374 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f3c8d0f-b74d-41e3-a48b-b4b76394a822 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:41.975846 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f3c8d0f-b74d-41e3-a48b-b4b76394a822 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:41.976303 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f3c8d0f-b74d-41e3-a48b-b4b76394a822 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:41.977029 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f3c8d0f-b74d-41e3-a48b-b4b76394a822 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:41.977471 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f3c8d0f-b74d-41e3-a48b-b4b76394a822 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:41.977894 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8f3c8d0f-b74d-41e3-a48b-b4b76394a822 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:42.111990 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8f3c8d0f-b74d-41e3-a48b-b4b76394a822 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:42.124039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8f3c8d0f-b74d-41e3-a48b-b4b76394a822 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.160043 Sep 06 16:20:42.124610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 334/677] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:41 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:42.599891 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6212169d-f8e5-4ba8-bb29-6a0fe84d7727 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:42.600495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6212169d-f8e5-4ba8-bb29-6a0fe84d7727 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:42.607463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6212169d-f8e5-4ba8-bb29-6a0fe84d7727 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:42.607953 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6212169d-f8e5-4ba8-bb29-6a0fe84d7727 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:42.608386 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6212169d-f8e5-4ba8-bb29-6a0fe84d7727 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:42.609117 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6212169d-f8e5-4ba8-bb29-6a0fe84d7727 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:42.609569 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6212169d-f8e5-4ba8-bb29-6a0fe84d7727 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:42.609987 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6212169d-f8e5-4ba8-bb29-6a0fe84d7727 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:42.750892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6212169d-f8e5-4ba8-bb29-6a0fe84d7727 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:42.761347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6212169d-f8e5-4ba8-bb29-6a0fe84d7727 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:42.762780 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6212169d-f8e5-4ba8-bb29-6a0fe84d7727 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:42.764000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6212169d-f8e5-4ba8-bb29-6a0fe84d7727 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.168111 Sep 06 16:20:42.764573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 344/678] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:42 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:43.148545 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-2dc61e8d-35ac-491c-8fb4-137bea18c930 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:43.149223 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-2dc61e8d-35ac-491c-8fb4-137bea18c930 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:43.156063 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2dc61e8d-35ac-491c-8fb4-137bea18c930 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:43.156545 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2dc61e8d-35ac-491c-8fb4-137bea18c930 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:43.157006 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2dc61e8d-35ac-491c-8fb4-137bea18c930 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:43.157699 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2dc61e8d-35ac-491c-8fb4-137bea18c930 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:43.158158 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2dc61e8d-35ac-491c-8fb4-137bea18c930 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:43.158579 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2dc61e8d-35ac-491c-8fb4-137bea18c930 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:43.301479 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-2dc61e8d-35ac-491c-8fb4-137bea18c930 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:43.310269 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-2dc61e8d-35ac-491c-8fb4-137bea18c930 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.165650 Sep 06 16:20:43.310832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 335/679] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:43 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:43.790522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-eb2d87d5-4c08-463a-9bb6-a99f786dc5c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:43.791272 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-eb2d87d5-4c08-463a-9bb6-a99f786dc5c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:43.799160 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eb2d87d5-4c08-463a-9bb6-a99f786dc5c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:43.799641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eb2d87d5-4c08-463a-9bb6-a99f786dc5c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:43.800496 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eb2d87d5-4c08-463a-9bb6-a99f786dc5c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:43.801488 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eb2d87d5-4c08-463a-9bb6-a99f786dc5c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:43.802151 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eb2d87d5-4c08-463a-9bb6-a99f786dc5c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:43.802777 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eb2d87d5-4c08-463a-9bb6-a99f786dc5c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:44.047570 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-eb2d87d5-4c08-463a-9bb6-a99f786dc5c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:44.057191 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-eb2d87d5-4c08-463a-9bb6-a99f786dc5c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:44.059159 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-eb2d87d5-4c08-463a-9bb6-a99f786dc5c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:44.060374 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-eb2d87d5-4c08-463a-9bb6-a99f786dc5c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.274135 Sep 06 16:20:44.061135 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 345/680] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:43 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:44.333567 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-99dc8f26-2002-4bca-ac09-743851969080 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:44.334103 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-99dc8f26-2002-4bca-ac09-743851969080 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:44.341576 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99dc8f26-2002-4bca-ac09-743851969080 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:44.341576 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99dc8f26-2002-4bca-ac09-743851969080 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:44.342072 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99dc8f26-2002-4bca-ac09-743851969080 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:44.342769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99dc8f26-2002-4bca-ac09-743851969080 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:44.343224 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99dc8f26-2002-4bca-ac09-743851969080 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:44.343650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-99dc8f26-2002-4bca-ac09-743851969080 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:44.489492 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-99dc8f26-2002-4bca-ac09-743851969080 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:44.500388 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-99dc8f26-2002-4bca-ac09-743851969080 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.170659 Sep 06 16:20:44.517359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 336/681] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:44 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:45.090752 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0518b395-a4fb-4fcf-84e0-e4fdd473cdea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:45.091561 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0518b395-a4fb-4fcf-84e0-e4fdd473cdea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:45.098064 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0518b395-a4fb-4fcf-84e0-e4fdd473cdea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:45.098545 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0518b395-a4fb-4fcf-84e0-e4fdd473cdea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:45.098975 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0518b395-a4fb-4fcf-84e0-e4fdd473cdea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:45.099665 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0518b395-a4fb-4fcf-84e0-e4fdd473cdea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:45.100092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0518b395-a4fb-4fcf-84e0-e4fdd473cdea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:45.100505 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0518b395-a4fb-4fcf-84e0-e4fdd473cdea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:45.257773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0518b395-a4fb-4fcf-84e0-e4fdd473cdea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:45.266823 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0518b395-a4fb-4fcf-84e0-e4fdd473cdea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:45.268361 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0518b395-a4fb-4fcf-84e0-e4fdd473cdea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:45.269635 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0518b395-a4fb-4fcf-84e0-e4fdd473cdea tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.182774 Sep 06 16:20:45.270305 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 346/682] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:45 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:45.525596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4419c36f-4af6-4a7c-8ab3-884ea39bd979 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:45.526415 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4419c36f-4af6-4a7c-8ab3-884ea39bd979 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:45.533605 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4419c36f-4af6-4a7c-8ab3-884ea39bd979 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:45.533970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4419c36f-4af6-4a7c-8ab3-884ea39bd979 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:45.534614 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4419c36f-4af6-4a7c-8ab3-884ea39bd979 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:45.535517 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4419c36f-4af6-4a7c-8ab3-884ea39bd979 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:45.535945 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4419c36f-4af6-4a7c-8ab3-884ea39bd979 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:45.536369 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4419c36f-4af6-4a7c-8ab3-884ea39bd979 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:45.540914 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:45.689936 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4419c36f-4af6-4a7c-8ab3-884ea39bd979 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:45.698611 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4419c36f-4af6-4a7c-8ab3-884ea39bd979 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.177463 Sep 06 16:20:45.699234 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 337/683] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:45 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:46.295335 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-27ad4f0f-253c-4df9-b4bc-2bbd07869db9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:46.296118 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-27ad4f0f-253c-4df9-b4bc-2bbd07869db9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:46.304463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-27ad4f0f-253c-4df9-b4bc-2bbd07869db9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:46.305286 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-27ad4f0f-253c-4df9-b4bc-2bbd07869db9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:46.305827 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-27ad4f0f-253c-4df9-b4bc-2bbd07869db9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:46.306718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-27ad4f0f-253c-4df9-b4bc-2bbd07869db9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:46.307371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-27ad4f0f-253c-4df9-b4bc-2bbd07869db9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:46.308264 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-27ad4f0f-253c-4df9-b4bc-2bbd07869db9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:46.444623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-27ad4f0f-253c-4df9-b4bc-2bbd07869db9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:46.458142 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-27ad4f0f-253c-4df9-b4bc-2bbd07869db9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:46.460329 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-27ad4f0f-253c-4df9-b4bc-2bbd07869db9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:46.462096 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-27ad4f0f-253c-4df9-b4bc-2bbd07869db9 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.170563 Sep 06 16:20:46.462841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 347/684] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:46 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:46.722461 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-512fe9d1-635e-45c5-8936-a0aa2b5f8c3b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:46.723069 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-512fe9d1-635e-45c5-8936-a0aa2b5f8c3b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:46.730719 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-512fe9d1-635e-45c5-8936-a0aa2b5f8c3b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:46.731548 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-512fe9d1-635e-45c5-8936-a0aa2b5f8c3b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:46.732061 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-512fe9d1-635e-45c5-8936-a0aa2b5f8c3b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:46.732843 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-512fe9d1-635e-45c5-8936-a0aa2b5f8c3b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:46.733499 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-512fe9d1-635e-45c5-8936-a0aa2b5f8c3b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:46.733920 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-512fe9d1-635e-45c5-8936-a0aa2b5f8c3b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:46.929468 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-512fe9d1-635e-45c5-8936-a0aa2b5f8c3b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:46.938313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-512fe9d1-635e-45c5-8936-a0aa2b5f8c3b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.220265 Sep 06 16:20:46.938861 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 338/685] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:46 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:47.487822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4374ab91-a6ed-4018-bc57-b7862912a706 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:47.488453 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4374ab91-a6ed-4018-bc57-b7862912a706 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:47.495076 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4374ab91-a6ed-4018-bc57-b7862912a706 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:47.495555 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4374ab91-a6ed-4018-bc57-b7862912a706 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:47.495980 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4374ab91-a6ed-4018-bc57-b7862912a706 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:47.496704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4374ab91-a6ed-4018-bc57-b7862912a706 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:47.497174 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4374ab91-a6ed-4018-bc57-b7862912a706 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:47.497620 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4374ab91-a6ed-4018-bc57-b7862912a706 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:47.643991 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4374ab91-a6ed-4018-bc57-b7862912a706 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:47.653629 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4374ab91-a6ed-4018-bc57-b7862912a706 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:47.655044 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4374ab91-a6ed-4018-bc57-b7862912a706 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:47.656206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4374ab91-a6ed-4018-bc57-b7862912a706 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.172370 Sep 06 16:20:47.656782 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 348/686] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:47 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:47.961680 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a950cf0f-b033-4ce5-971b-328a752ae9e9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:47.962520 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a950cf0f-b033-4ce5-971b-328a752ae9e9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:47.969121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a950cf0f-b033-4ce5-971b-328a752ae9e9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:47.969599 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a950cf0f-b033-4ce5-971b-328a752ae9e9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:47.970049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a950cf0f-b033-4ce5-971b-328a752ae9e9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:47.970706 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a950cf0f-b033-4ce5-971b-328a752ae9e9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:47.971165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a950cf0f-b033-4ce5-971b-328a752ae9e9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:47.971566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a950cf0f-b033-4ce5-971b-328a752ae9e9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:48.112826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a950cf0f-b033-4ce5-971b-328a752ae9e9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:48.122781 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a950cf0f-b033-4ce5-971b-328a752ae9e9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.164906 Sep 06 16:20:48.123453 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 339/687] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:47 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:48.686536 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3b3440fb-d89c-4f5a-8cc4-d09c033fdd1e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:48.687441 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3b3440fb-d89c-4f5a-8cc4-d09c033fdd1e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:48.698173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3b3440fb-d89c-4f5a-8cc4-d09c033fdd1e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:48.698979 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3b3440fb-d89c-4f5a-8cc4-d09c033fdd1e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:48.699786 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3b3440fb-d89c-4f5a-8cc4-d09c033fdd1e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:48.700477 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3b3440fb-d89c-4f5a-8cc4-d09c033fdd1e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:48.700970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3b3440fb-d89c-4f5a-8cc4-d09c033fdd1e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:48.701395 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3b3440fb-d89c-4f5a-8cc4-d09c033fdd1e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:48.842450 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3b3440fb-d89c-4f5a-8cc4-d09c033fdd1e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:48.851439 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3b3440fb-d89c-4f5a-8cc4-d09c033fdd1e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:48.852903 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3b3440fb-d89c-4f5a-8cc4-d09c033fdd1e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:48.854057 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3b3440fb-d89c-4f5a-8cc4-d09c033fdd1e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.174480 Sep 06 16:20:48.854652 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 349/688] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:48 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:49.146979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-df3e9a65-4775-469d-8018-676fa8b975b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:49.147632 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-df3e9a65-4775-469d-8018-676fa8b975b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:49.154519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df3e9a65-4775-469d-8018-676fa8b975b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:49.155010 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df3e9a65-4775-469d-8018-676fa8b975b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:49.155445 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df3e9a65-4775-469d-8018-676fa8b975b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:49.156145 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df3e9a65-4775-469d-8018-676fa8b975b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:49.156594 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df3e9a65-4775-469d-8018-676fa8b975b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:49.157521 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-df3e9a65-4775-469d-8018-676fa8b975b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:49.302465 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-df3e9a65-4775-469d-8018-676fa8b975b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:49.312077 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-df3e9a65-4775-469d-8018-676fa8b975b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.169215 Sep 06 16:20:49.313099 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 340/689] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:49 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:49.885079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-76c2db9b-41f3-4361-84b9-cad26e25d858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:49.886125 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-76c2db9b-41f3-4361-84b9-cad26e25d858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:49.894302 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76c2db9b-41f3-4361-84b9-cad26e25d858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:49.894792 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76c2db9b-41f3-4361-84b9-cad26e25d858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:49.895220 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76c2db9b-41f3-4361-84b9-cad26e25d858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:49.895923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76c2db9b-41f3-4361-84b9-cad26e25d858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:49.896369 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76c2db9b-41f3-4361-84b9-cad26e25d858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:49.896800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76c2db9b-41f3-4361-84b9-cad26e25d858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:50.118218 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-76c2db9b-41f3-4361-84b9-cad26e25d858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:50.127864 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-76c2db9b-41f3-4361-84b9-cad26e25d858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:50.129558 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-76c2db9b-41f3-4361-84b9-cad26e25d858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:50.130839 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-76c2db9b-41f3-4361-84b9-cad26e25d858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.253593 Sep 06 16:20:50.131564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 350/690] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:49 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:50.336561 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ba736b78-576f-42e7-8220-c7c562268b54 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:50.337558 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ba736b78-576f-42e7-8220-c7c562268b54 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:50.344612 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba736b78-576f-42e7-8220-c7c562268b54 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:50.345125 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba736b78-576f-42e7-8220-c7c562268b54 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:50.345548 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba736b78-576f-42e7-8220-c7c562268b54 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:50.346262 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba736b78-576f-42e7-8220-c7c562268b54 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:50.346717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba736b78-576f-42e7-8220-c7c562268b54 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:50.347152 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba736b78-576f-42e7-8220-c7c562268b54 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:50.513097 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ba736b78-576f-42e7-8220-c7c562268b54 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:50.525937 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ba736b78-576f-42e7-8220-c7c562268b54 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.191570 Sep 06 16:20:50.526460 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 341/691] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:50 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:51.158216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-81961f7d-381d-453f-bb63-f4d4f597f703 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:51.158865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-81961f7d-381d-453f-bb63-f4d4f597f703 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:51.165897 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-81961f7d-381d-453f-bb63-f4d4f597f703 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:51.166386 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-81961f7d-381d-453f-bb63-f4d4f597f703 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:51.166825 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-81961f7d-381d-453f-bb63-f4d4f597f703 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:51.167534 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-81961f7d-381d-453f-bb63-f4d4f597f703 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:51.167985 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-81961f7d-381d-453f-bb63-f4d4f597f703 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:51.168405 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-81961f7d-381d-453f-bb63-f4d4f597f703 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:51.315255 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-81961f7d-381d-453f-bb63-f4d4f597f703 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:51.324378 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-81961f7d-381d-453f-bb63-f4d4f597f703 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:51.325841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-81961f7d-381d-453f-bb63-f4d4f597f703 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:51.327003 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-81961f7d-381d-453f-bb63-f4d4f597f703 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.172752 Sep 06 16:20:51.327567 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 351/692] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:51 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:51.547897 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4837c5e3-e386-47cc-aa90-165ddadda477 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:51.548703 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4837c5e3-e386-47cc-aa90-165ddadda477 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:51.557041 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4837c5e3-e386-47cc-aa90-165ddadda477 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:51.558383 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4837c5e3-e386-47cc-aa90-165ddadda477 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:51.559118 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4837c5e3-e386-47cc-aa90-165ddadda477 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:51.560316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4837c5e3-e386-47cc-aa90-165ddadda477 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:51.561015 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4837c5e3-e386-47cc-aa90-165ddadda477 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:51.561702 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4837c5e3-e386-47cc-aa90-165ddadda477 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:51.760431 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4837c5e3-e386-47cc-aa90-165ddadda477 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:51.779569 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4837c5e3-e386-47cc-aa90-165ddadda477 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.236142 Sep 06 16:20:51.780189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 342/693] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:51 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:52.369348 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-cbefacdf-faea-4455-9d9f-a1294d444e18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:52.369916 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-cbefacdf-faea-4455-9d9f-a1294d444e18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:52.376874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cbefacdf-faea-4455-9d9f-a1294d444e18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:52.377365 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cbefacdf-faea-4455-9d9f-a1294d444e18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:52.377791 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cbefacdf-faea-4455-9d9f-a1294d444e18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:52.378492 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cbefacdf-faea-4455-9d9f-a1294d444e18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:52.378916 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cbefacdf-faea-4455-9d9f-a1294d444e18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:52.379341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cbefacdf-faea-4455-9d9f-a1294d444e18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:52.400605 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:52.520712 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cbefacdf-faea-4455-9d9f-a1294d444e18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:52.530750 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cbefacdf-faea-4455-9d9f-a1294d444e18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:52.532194 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cbefacdf-faea-4455-9d9f-a1294d444e18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:52.533382 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-cbefacdf-faea-4455-9d9f-a1294d444e18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.169935 Sep 06 16:20:52.533940 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 352/694] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:52 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:52.808432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0dc35aa9-4438-4f19-a1a1-6a20d0c96d9d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:52.809218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0dc35aa9-4438-4f19-a1a1-6a20d0c96d9d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:52.817264 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0dc35aa9-4438-4f19-a1a1-6a20d0c96d9d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:52.817886 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0dc35aa9-4438-4f19-a1a1-6a20d0c96d9d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:52.818209 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0dc35aa9-4438-4f19-a1a1-6a20d0c96d9d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:52.824644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0dc35aa9-4438-4f19-a1a1-6a20d0c96d9d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:52.824644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0dc35aa9-4438-4f19-a1a1-6a20d0c96d9d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:52.824644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0dc35aa9-4438-4f19-a1a1-6a20d0c96d9d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:52.960579 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0dc35aa9-4438-4f19-a1a1-6a20d0c96d9d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:52.973565 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0dc35aa9-4438-4f19-a1a1-6a20d0c96d9d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.170105 Sep 06 16:20:52.974241 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 343/695] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:52 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:53.560137 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6c390121-dfd1-4162-bd46-6df1bd14e37d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:53.560921 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6c390121-dfd1-4162-bd46-6df1bd14e37d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:53.567662 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6c390121-dfd1-4162-bd46-6df1bd14e37d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:53.568251 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6c390121-dfd1-4162-bd46-6df1bd14e37d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:53.568774 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6c390121-dfd1-4162-bd46-6df1bd14e37d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:53.569792 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6c390121-dfd1-4162-bd46-6df1bd14e37d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:53.570319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6c390121-dfd1-4162-bd46-6df1bd14e37d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:53.570816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6c390121-dfd1-4162-bd46-6df1bd14e37d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:53.721487 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6c390121-dfd1-4162-bd46-6df1bd14e37d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:53.730798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6c390121-dfd1-4162-bd46-6df1bd14e37d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:53.732217 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6c390121-dfd1-4162-bd46-6df1bd14e37d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:53.733617 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6c390121-dfd1-4162-bd46-6df1bd14e37d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.177809 Sep 06 16:20:53.734178 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 353/696] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:53 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:53.997692 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f5205dff-ea76-4aa4-b0a7-2c795e19c841 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:53.998364 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f5205dff-ea76-4aa4-b0a7-2c795e19c841 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:54.006137 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5205dff-ea76-4aa4-b0a7-2c795e19c841 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:54.006634 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5205dff-ea76-4aa4-b0a7-2c795e19c841 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:54.007275 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5205dff-ea76-4aa4-b0a7-2c795e19c841 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:54.008070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5205dff-ea76-4aa4-b0a7-2c795e19c841 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:54.008532 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5205dff-ea76-4aa4-b0a7-2c795e19c841 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:54.008990 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5205dff-ea76-4aa4-b0a7-2c795e19c841 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:54.153931 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f5205dff-ea76-4aa4-b0a7-2c795e19c841 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:54.163448 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f5205dff-ea76-4aa4-b0a7-2c795e19c841 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.169932 Sep 06 16:20:54.165095 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 344/697] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:53 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:54.759921 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-30dc160c-095c-423b-847c-37d8025d6f6f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:54.760612 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-30dc160c-095c-423b-847c-37d8025d6f6f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:54.767321 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-30dc160c-095c-423b-847c-37d8025d6f6f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:54.767842 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-30dc160c-095c-423b-847c-37d8025d6f6f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:54.768240 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-30dc160c-095c-423b-847c-37d8025d6f6f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:54.768977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-30dc160c-095c-423b-847c-37d8025d6f6f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:54.769400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-30dc160c-095c-423b-847c-37d8025d6f6f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:54.769828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-30dc160c-095c-423b-847c-37d8025d6f6f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:54.930019 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-30dc160c-095c-423b-847c-37d8025d6f6f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:54.940075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-30dc160c-095c-423b-847c-37d8025d6f6f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:54.941559 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-30dc160c-095c-423b-847c-37d8025d6f6f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:54.942763 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-30dc160c-095c-423b-847c-37d8025d6f6f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.186846 Sep 06 16:20:54.943328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 354/698] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:54 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:55.310678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cec81d4b-36ed-4c2c-a9e5-a8943a99a0b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:55.315164 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cec81d4b-36ed-4c2c-a9e5-a8943a99a0b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:55.321200 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cec81d4b-36ed-4c2c-a9e5-a8943a99a0b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:55.321899 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cec81d4b-36ed-4c2c-a9e5-a8943a99a0b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:55.322429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cec81d4b-36ed-4c2c-a9e5-a8943a99a0b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:55.323344 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cec81d4b-36ed-4c2c-a9e5-a8943a99a0b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:55.323851 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cec81d4b-36ed-4c2c-a9e5-a8943a99a0b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:55.324536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cec81d4b-36ed-4c2c-a9e5-a8943a99a0b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:55.464233 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cec81d4b-36ed-4c2c-a9e5-a8943a99a0b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:55.477964 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cec81d4b-36ed-4c2c-a9e5-a8943a99a0b8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.293461 Sep 06 16:20:55.478715 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 345/699] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:55 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:55.981537 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e752b946-1b24-452f-a5ae-36455eaa0338 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:55.982167 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e752b946-1b24-452f-a5ae-36455eaa0338 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:55.989867 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e752b946-1b24-452f-a5ae-36455eaa0338 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:55.990344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e752b946-1b24-452f-a5ae-36455eaa0338 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:55.990753 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e752b946-1b24-452f-a5ae-36455eaa0338 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:55.991446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e752b946-1b24-452f-a5ae-36455eaa0338 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:55.991883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e752b946-1b24-452f-a5ae-36455eaa0338 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:55.992293 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e752b946-1b24-452f-a5ae-36455eaa0338 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:56.138769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e752b946-1b24-452f-a5ae-36455eaa0338 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:56.148369 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e752b946-1b24-452f-a5ae-36455eaa0338 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:56.149781 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e752b946-1b24-452f-a5ae-36455eaa0338 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:56.150956 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e752b946-1b24-452f-a5ae-36455eaa0338 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.173596 Sep 06 16:20:56.152988 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 355/700] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:55 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:56.502759 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-31c9f24b-3f5b-4044-a8b6-61aec2c5e353 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:56.503310 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-31c9f24b-3f5b-4044-a8b6-61aec2c5e353 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:56.510141 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31c9f24b-3f5b-4044-a8b6-61aec2c5e353 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:56.510625 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31c9f24b-3f5b-4044-a8b6-61aec2c5e353 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:56.511032 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31c9f24b-3f5b-4044-a8b6-61aec2c5e353 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:56.511714 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31c9f24b-3f5b-4044-a8b6-61aec2c5e353 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:56.512208 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31c9f24b-3f5b-4044-a8b6-61aec2c5e353 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:56.512651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31c9f24b-3f5b-4044-a8b6-61aec2c5e353 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:56.660355 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-31c9f24b-3f5b-4044-a8b6-61aec2c5e353 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:56.669152 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-31c9f24b-3f5b-4044-a8b6-61aec2c5e353 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.170393 Sep 06 16:20:56.670019 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 346/701] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:56 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:57.293234 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5a26caca-e072-441c-9ecb-82a349d86311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:57.293843 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5a26caca-e072-441c-9ecb-82a349d86311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:57.299743 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5a26caca-e072-441c-9ecb-82a349d86311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:57.300220 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5a26caca-e072-441c-9ecb-82a349d86311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:57.300648 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5a26caca-e072-441c-9ecb-82a349d86311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:57.301348 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5a26caca-e072-441c-9ecb-82a349d86311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:57.301792 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5a26caca-e072-441c-9ecb-82a349d86311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:57.302205 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5a26caca-e072-441c-9ecb-82a349d86311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:57.437614 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5a26caca-e072-441c-9ecb-82a349d86311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:57.446515 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5a26caca-e072-441c-9ecb-82a349d86311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:57.447942 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5a26caca-e072-441c-9ecb-82a349d86311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:57.449168 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5a26caca-e072-441c-9ecb-82a349d86311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.274422 Sep 06 16:20:57.452046 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 356/702] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:57 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:57.694235 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b12d3d46-51aa-4d8b-a4f9-2e50b1e384a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:57.694803 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b12d3d46-51aa-4d8b-a4f9-2e50b1e384a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:57.702564 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b12d3d46-51aa-4d8b-a4f9-2e50b1e384a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:57.703020 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b12d3d46-51aa-4d8b-a4f9-2e50b1e384a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:57.703449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b12d3d46-51aa-4d8b-a4f9-2e50b1e384a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:57.704405 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b12d3d46-51aa-4d8b-a4f9-2e50b1e384a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:57.704588 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b12d3d46-51aa-4d8b-a4f9-2e50b1e384a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:57.705035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b12d3d46-51aa-4d8b-a4f9-2e50b1e384a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:57.843156 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b12d3d46-51aa-4d8b-a4f9-2e50b1e384a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:57.852110 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b12d3d46-51aa-4d8b-a4f9-2e50b1e384a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.163126 Sep 06 16:20:57.852728 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 347/703] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:57 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:58.477544 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ed990da6-c2e5-4933-9ad6-c401a61d40ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:58.478906 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ed990da6-c2e5-4933-9ad6-c401a61d40ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:58.486092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed990da6-c2e5-4933-9ad6-c401a61d40ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:58.486572 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed990da6-c2e5-4933-9ad6-c401a61d40ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:58.487007 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed990da6-c2e5-4933-9ad6-c401a61d40ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:58.487691 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed990da6-c2e5-4933-9ad6-c401a61d40ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:58.488139 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed990da6-c2e5-4933-9ad6-c401a61d40ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:58.488556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed990da6-c2e5-4933-9ad6-c401a61d40ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:58.622338 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ed990da6-c2e5-4933-9ad6-c401a61d40ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:58.631447 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ed990da6-c2e5-4933-9ad6-c401a61d40ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:58.632883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ed990da6-c2e5-4933-9ad6-c401a61d40ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:58.634252 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ed990da6-c2e5-4933-9ad6-c401a61d40ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.161516 Sep 06 16:20:58.634812 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 357/704] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:58 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:20:58.875810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-333b70d4-f452-4c7c-a8fa-932fd88371a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:58.876360 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-333b70d4-f452-4c7c-a8fa-932fd88371a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:58.883692 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-333b70d4-f452-4c7c-a8fa-932fd88371a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:58.884170 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-333b70d4-f452-4c7c-a8fa-932fd88371a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:58.884599 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-333b70d4-f452-4c7c-a8fa-932fd88371a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:58.885326 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-333b70d4-f452-4c7c-a8fa-932fd88371a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:58.885769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-333b70d4-f452-4c7c-a8fa-932fd88371a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:58.886188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-333b70d4-f452-4c7c-a8fa-932fd88371a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:59.030800 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-333b70d4-f452-4c7c-a8fa-932fd88371a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:59.057186 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-333b70d4-f452-4c7c-a8fa-932fd88371a6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1725 microversion: 2.1 time: 0.184706 Sep 06 16:20:59.058654 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 348/705] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:58 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:59.659256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-80d66b0a-64cc-412f-bb55-cbbf692e2257 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:59.659911 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-80d66b0a-64cc-412f-bb55-cbbf692e2257 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:59.666627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-80d66b0a-64cc-412f-bb55-cbbf692e2257 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:59.667112 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-80d66b0a-64cc-412f-bb55-cbbf692e2257 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:59.667546 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-80d66b0a-64cc-412f-bb55-cbbf692e2257 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:59.668317 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-80d66b0a-64cc-412f-bb55-cbbf692e2257 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:59.668787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-80d66b0a-64cc-412f-bb55-cbbf692e2257 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:59.669215 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-80d66b0a-64cc-412f-bb55-cbbf692e2257 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:59.809899 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-80d66b0a-64cc-412f-bb55-cbbf692e2257 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:59.820793 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-80d66b0a-64cc-412f-bb55-cbbf692e2257 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:59.822228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-80d66b0a-64cc-412f-bb55-cbbf692e2257 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:59.823409 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-80d66b0a-64cc-412f-bb55-cbbf692e2257 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.168169 Sep 06 16:20:59.824064 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 358/706] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:20:59 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:00.082508 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-380d936a-f3f3-4760-a060-c8e930ffd464 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:00.083043 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-380d936a-f3f3-4760-a060-c8e930ffd464 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:00.090570 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-380d936a-f3f3-4760-a060-c8e930ffd464 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:00.091054 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-380d936a-f3f3-4760-a060-c8e930ffd464 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:00.091521 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-380d936a-f3f3-4760-a060-c8e930ffd464 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:00.092230 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-380d936a-f3f3-4760-a060-c8e930ffd464 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:00.092680 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-380d936a-f3f3-4760-a060-c8e930ffd464 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:00.093159 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-380d936a-f3f3-4760-a060-c8e930ffd464 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:00.233222 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-380d936a-f3f3-4760-a060-c8e930ffd464 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:00.242081 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-380d936a-f3f3-4760-a060-c8e930ffd464 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1702 microversion: 2.1 time: 0.163503 Sep 06 16:21:00.242657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 349/707] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:00 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1702 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:00.265533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-82b0ab91-2265-4582-9958-e86c7f50b6e7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:00.272091 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-82b0ab91-2265-4582-9958-e86c7f50b6e7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:00.272586 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-82b0ab91-2265-4582-9958-e86c7f50b6e7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:00.273045 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-82b0ab91-2265-4582-9958-e86c7f50b6e7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:00.298852 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-82b0ab91-2265-4582-9958-e86c7f50b6e7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Going to try to start instance {{(pid=120668) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 16:21:00.351592 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-82b0ab91-2265-4582-9958-e86c7f50b6e7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "POST /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/action" status: 202 len: 0 microversion: 2.1 time: 0.090101 Sep 06 16:21:00.352190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 359/708] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:21:00 2022] POST /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:21:00.360741 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8730fb3a-7ab9-472e-8d44-6867ca59ceb2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:00.361379 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8730fb3a-7ab9-472e-8d44-6867ca59ceb2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:00.368090 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8730fb3a-7ab9-472e-8d44-6867ca59ceb2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:00.368624 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8730fb3a-7ab9-472e-8d44-6867ca59ceb2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:00.369075 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8730fb3a-7ab9-472e-8d44-6867ca59ceb2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:00.369788 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8730fb3a-7ab9-472e-8d44-6867ca59ceb2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:00.370271 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8730fb3a-7ab9-472e-8d44-6867ca59ceb2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:00.370677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8730fb3a-7ab9-472e-8d44-6867ca59ceb2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:00.511670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8730fb3a-7ab9-472e-8d44-6867ca59ceb2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:00.522705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8730fb3a-7ab9-472e-8d44-6867ca59ceb2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1711 microversion: 2.1 time: 0.165609 Sep 06 16:21:00.523313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 350/709] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:00 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1711 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:00.852391 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9f2869e9-0be7-439a-b8c7-6b35c52eb695 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:00.853691 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9f2869e9-0be7-439a-b8c7-6b35c52eb695 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:00.863457 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9f2869e9-0be7-439a-b8c7-6b35c52eb695 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:00.864198 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9f2869e9-0be7-439a-b8c7-6b35c52eb695 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:00.864841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9f2869e9-0be7-439a-b8c7-6b35c52eb695 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:00.865929 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9f2869e9-0be7-439a-b8c7-6b35c52eb695 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:00.866552 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9f2869e9-0be7-439a-b8c7-6b35c52eb695 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:00.867229 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9f2869e9-0be7-439a-b8c7-6b35c52eb695 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:01.026531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9f2869e9-0be7-439a-b8c7-6b35c52eb695 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:01.035775 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9f2869e9-0be7-439a-b8c7-6b35c52eb695 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:01.037258 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9f2869e9-0be7-439a-b8c7-6b35c52eb695 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:01.038418 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9f2869e9-0be7-439a-b8c7-6b35c52eb695 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.192910 Sep 06 16:21:01.038969 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 360/710] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:00 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:01.547871 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4de7a793-2304-48f2-9f20-224351145f6b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:01.548462 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4de7a793-2304-48f2-9f20-224351145f6b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:01.550831 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=52 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:01.556620 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4de7a793-2304-48f2-9f20-224351145f6b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:01.557139 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4de7a793-2304-48f2-9f20-224351145f6b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:01.557573 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4de7a793-2304-48f2-9f20-224351145f6b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:01.558690 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4de7a793-2304-48f2-9f20-224351145f6b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:01.559140 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4de7a793-2304-48f2-9f20-224351145f6b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:01.559564 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4de7a793-2304-48f2-9f20-224351145f6b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:01.708025 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4de7a793-2304-48f2-9f20-224351145f6b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:01.717028 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4de7a793-2304-48f2-9f20-224351145f6b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1711 microversion: 2.1 time: 0.173069 Sep 06 16:21:01.717605 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 351/711] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:01 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1711 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:02.064461 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e7b99147-74f2-4a40-b8ef-b0053a46a24d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:02.065100 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e7b99147-74f2-4a40-b8ef-b0053a46a24d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:02.072563 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e7b99147-74f2-4a40-b8ef-b0053a46a24d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:02.073075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e7b99147-74f2-4a40-b8ef-b0053a46a24d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:02.073504 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e7b99147-74f2-4a40-b8ef-b0053a46a24d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:02.074274 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e7b99147-74f2-4a40-b8ef-b0053a46a24d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:02.074719 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e7b99147-74f2-4a40-b8ef-b0053a46a24d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:02.075133 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e7b99147-74f2-4a40-b8ef-b0053a46a24d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:02.210804 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e7b99147-74f2-4a40-b8ef-b0053a46a24d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:02.219617 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e7b99147-74f2-4a40-b8ef-b0053a46a24d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:02.221087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e7b99147-74f2-4a40-b8ef-b0053a46a24d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:02.222259 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e7b99147-74f2-4a40-b8ef-b0053a46a24d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.161819 Sep 06 16:21:02.222820 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 361/712] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:02 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:02.750035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5e6a73b7-11a9-4336-9710-ad6c593fe0eb tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:02.750658 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5e6a73b7-11a9-4336-9710-ad6c593fe0eb tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:02.757246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5e6a73b7-11a9-4336-9710-ad6c593fe0eb tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:02.757952 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5e6a73b7-11a9-4336-9710-ad6c593fe0eb tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:02.758604 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5e6a73b7-11a9-4336-9710-ad6c593fe0eb tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:02.759346 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5e6a73b7-11a9-4336-9710-ad6c593fe0eb tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:02.759786 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5e6a73b7-11a9-4336-9710-ad6c593fe0eb tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:02.760188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5e6a73b7-11a9-4336-9710-ad6c593fe0eb tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:03.032258 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5e6a73b7-11a9-4336-9710-ad6c593fe0eb tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:03.043426 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5e6a73b7-11a9-4336-9710-ad6c593fe0eb tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1711 microversion: 2.1 time: 0.297420 Sep 06 16:21:03.044115 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 352/713] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:02 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1711 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:03.248896 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-bd32134f-b066-4d19-b7cc-89f706dba2c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:03.250173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-bd32134f-b066-4d19-b7cc-89f706dba2c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:03.257642 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd32134f-b066-4d19-b7cc-89f706dba2c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:03.257945 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd32134f-b066-4d19-b7cc-89f706dba2c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:03.258284 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd32134f-b066-4d19-b7cc-89f706dba2c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:03.259018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd32134f-b066-4d19-b7cc-89f706dba2c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:03.259489 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd32134f-b066-4d19-b7cc-89f706dba2c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:03.259984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd32134f-b066-4d19-b7cc-89f706dba2c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:03.402109 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-78e15808-f38e-4643-9feb-bfba6716943c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:03.402900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-78e15808-f38e-4643-9feb-bfba6716943c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:03.405001 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-bd32134f-b066-4d19-b7cc-89f706dba2c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:03.409459 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78e15808-f38e-4643-9feb-bfba6716943c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:03.410142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78e15808-f38e-4643-9feb-bfba6716943c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:03.410579 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78e15808-f38e-4643-9feb-bfba6716943c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:03.411311 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78e15808-f38e-4643-9feb-bfba6716943c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:03.411760 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78e15808-f38e-4643-9feb-bfba6716943c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:03.412178 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78e15808-f38e-4643-9feb-bfba6716943c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:03.414614 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-bd32134f-b066-4d19-b7cc-89f706dba2c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:03.416131 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-bd32134f-b066-4d19-b7cc-89f706dba2c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:03.417427 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-bd32134f-b066-4d19-b7cc-89f706dba2c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.173695 Sep 06 16:21:03.418271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 362/714] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:03 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:03.544715 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:03.549972 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-78e15808-f38e-4643-9feb-bfba6716943c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lazy-loading 'services' on Instance uuid e546ddd0-81de-42c6-8fbd-6d660af7feba {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:21:03.669506 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-78e15808-f38e-4643-9feb-bfba6716943c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba/os-volume_attachments/13eca4ad-c51c-4690-99dc-1aadc055a4ff" status: 202 len: 0 microversion: 2.1 time: 0.272182 Sep 06 16:21:03.670087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 353/715] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 6 16:21:03 2022] DELETE /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba/os-volume_attachments/13eca4ad-c51c-4690-99dc-1aadc055a4ff => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:21:04.070704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-29bb4ba9-b257-4564-9525-64d3cfeb622f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:04.071841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-29bb4ba9-b257-4564-9525-64d3cfeb622f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:04.079732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29bb4ba9-b257-4564-9525-64d3cfeb622f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:04.080499 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29bb4ba9-b257-4564-9525-64d3cfeb622f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:04.080663 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29bb4ba9-b257-4564-9525-64d3cfeb622f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:04.081947 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29bb4ba9-b257-4564-9525-64d3cfeb622f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:04.081947 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29bb4ba9-b257-4564-9525-64d3cfeb622f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:04.084228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29bb4ba9-b257-4564-9525-64d3cfeb622f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:04.227522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-29bb4ba9-b257-4564-9525-64d3cfeb622f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:04.236372 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-29bb4ba9-b257-4564-9525-64d3cfeb622f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1711 microversion: 2.1 time: 0.172405 Sep 06 16:21:04.237126 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 363/716] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:04 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1711 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:04.446299 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-914bf560-f11e-425e-947e-c3d2bfc7d7c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:04.446900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-914bf560-f11e-425e-947e-c3d2bfc7d7c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:04.454078 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-914bf560-f11e-425e-947e-c3d2bfc7d7c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:04.455916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-914bf560-f11e-425e-947e-c3d2bfc7d7c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:04.455916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-914bf560-f11e-425e-947e-c3d2bfc7d7c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:04.455916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-914bf560-f11e-425e-947e-c3d2bfc7d7c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:04.456204 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-914bf560-f11e-425e-947e-c3d2bfc7d7c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:04.456508 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-914bf560-f11e-425e-947e-c3d2bfc7d7c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:04.597620 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-914bf560-f11e-425e-947e-c3d2bfc7d7c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:04.609915 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-914bf560-f11e-425e-947e-c3d2bfc7d7c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:04.611391 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-914bf560-f11e-425e-947e-c3d2bfc7d7c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:04.612557 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-914bf560-f11e-425e-947e-c3d2bfc7d7c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.171235 Sep 06 16:21:04.613156 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 354/717] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:04 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:05.263256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4cad5db6-5890-455d-ae6b-d6e996b1fde7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:05.263256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4cad5db6-5890-455d-ae6b-d6e996b1fde7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:05.269834 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4cad5db6-5890-455d-ae6b-d6e996b1fde7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:05.270219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4cad5db6-5890-455d-ae6b-d6e996b1fde7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:05.270647 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4cad5db6-5890-455d-ae6b-d6e996b1fde7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:05.271442 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4cad5db6-5890-455d-ae6b-d6e996b1fde7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:05.272071 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4cad5db6-5890-455d-ae6b-d6e996b1fde7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:05.272493 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4cad5db6-5890-455d-ae6b-d6e996b1fde7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:05.414844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4cad5db6-5890-455d-ae6b-d6e996b1fde7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:05.424486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4cad5db6-5890-455d-ae6b-d6e996b1fde7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1711 microversion: 2.1 time: 0.167292 Sep 06 16:21:05.425977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 364/718] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:05 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1711 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:05.641149 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7261c726-33ee-405e-b681-2ab0b227eb2d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:05.642762 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7261c726-33ee-405e-b681-2ab0b227eb2d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:05.653398 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7261c726-33ee-405e-b681-2ab0b227eb2d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:05.654252 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7261c726-33ee-405e-b681-2ab0b227eb2d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:05.654989 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7261c726-33ee-405e-b681-2ab0b227eb2d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:05.656258 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7261c726-33ee-405e-b681-2ab0b227eb2d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:05.660915 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7261c726-33ee-405e-b681-2ab0b227eb2d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:05.661420 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7261c726-33ee-405e-b681-2ab0b227eb2d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:05.815660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7261c726-33ee-405e-b681-2ab0b227eb2d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:05.825429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7261c726-33ee-405e-b681-2ab0b227eb2d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:05.826874 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7261c726-33ee-405e-b681-2ab0b227eb2d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:05.828045 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7261c726-33ee-405e-b681-2ab0b227eb2d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.193970 Sep 06 16:21:05.828613 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 355/719] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:05 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:05.879226 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-22884d9b-4709-473c-a70e-2eb7480c716c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:05.879725 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-22884d9b-4709-473c-a70e-2eb7480c716c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:05.886588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-22884d9b-4709-473c-a70e-2eb7480c716c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:05.887099 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-22884d9b-4709-473c-a70e-2eb7480c716c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:05.887535 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-22884d9b-4709-473c-a70e-2eb7480c716c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:05.888636 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-22884d9b-4709-473c-a70e-2eb7480c716c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:05.888798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-22884d9b-4709-473c-a70e-2eb7480c716c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:05.889129 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-22884d9b-4709-473c-a70e-2eb7480c716c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:05.915811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-22884d9b-4709-473c-a70e-2eb7480c716c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Going to try to terminate instance {{(pid=120668) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:21:06.018371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-22884d9b-4709-473c-a70e-2eb7480c716c tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 204 len: 0 microversion: 2.1 time: 0.143155 Sep 06 16:21:06.022372 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 365/720] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:21:05 2022] DELETE /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:21:06.031928 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-43a0a932-ad1b-4dfe-a758-deb6248d7523 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:06.032613 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-43a0a932-ad1b-4dfe-a758-deb6248d7523 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:06.039705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43a0a932-ad1b-4dfe-a758-deb6248d7523 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:06.040595 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43a0a932-ad1b-4dfe-a758-deb6248d7523 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:06.041372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43a0a932-ad1b-4dfe-a758-deb6248d7523 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:06.043039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43a0a932-ad1b-4dfe-a758-deb6248d7523 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:06.043429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43a0a932-ad1b-4dfe-a758-deb6248d7523 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:06.043923 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43a0a932-ad1b-4dfe-a758-deb6248d7523 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:06.194225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-43a0a932-ad1b-4dfe-a758-deb6248d7523 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:06.203904 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-43a0a932-ad1b-4dfe-a758-deb6248d7523 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1515 microversion: 2.1 time: 0.176513 Sep 06 16:21:06.204551 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 356/721] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:06 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:06.452197 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ac659918-aa06-4792-bbe2-988906033829 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:06.452809 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ac659918-aa06-4792-bbe2-988906033829 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:06.459441 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ac659918-aa06-4792-bbe2-988906033829 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:06.459916 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ac659918-aa06-4792-bbe2-988906033829 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:06.460375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ac659918-aa06-4792-bbe2-988906033829 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:06.461103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ac659918-aa06-4792-bbe2-988906033829 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:06.461551 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ac659918-aa06-4792-bbe2-988906033829 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:06.462307 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ac659918-aa06-4792-bbe2-988906033829 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:06.482830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:06.600467 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ac659918-aa06-4792-bbe2-988906033829 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:06.609974 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ac659918-aa06-4792-bbe2-988906033829 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1715 microversion: 2.1 time: 0.162211 Sep 06 16:21:06.610650 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 366/722] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:06 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:06.853923 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-534966b8-5066-4631-adf9-d116593c4456 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:06.855480 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-534966b8-5066-4631-adf9-d116593c4456 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:06.866205 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-534966b8-5066-4631-adf9-d116593c4456 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:06.866922 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-534966b8-5066-4631-adf9-d116593c4456 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:06.867629 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-534966b8-5066-4631-adf9-d116593c4456 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:06.868717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-534966b8-5066-4631-adf9-d116593c4456 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:06.869282 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-534966b8-5066-4631-adf9-d116593c4456 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:06.869941 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-534966b8-5066-4631-adf9-d116593c4456 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:07.022652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-534966b8-5066-4631-adf9-d116593c4456 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:07.032823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-534966b8-5066-4631-adf9-d116593c4456 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:07.034260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-534966b8-5066-4631-adf9-d116593c4456 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:07.035438 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-534966b8-5066-4631-adf9-d116593c4456 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.185539 Sep 06 16:21:07.036101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 357/723] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:06 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:07.232537 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1c87a3fe-6def-4a0c-b007-1856394a8e94 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:07.233189 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1c87a3fe-6def-4a0c-b007-1856394a8e94 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:07.239533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1c87a3fe-6def-4a0c-b007-1856394a8e94 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:07.239918 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1c87a3fe-6def-4a0c-b007-1856394a8e94 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:07.240349 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1c87a3fe-6def-4a0c-b007-1856394a8e94 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:07.241072 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1c87a3fe-6def-4a0c-b007-1856394a8e94 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:07.241519 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1c87a3fe-6def-4a0c-b007-1856394a8e94 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:07.241933 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1c87a3fe-6def-4a0c-b007-1856394a8e94 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:07.619630 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1c87a3fe-6def-4a0c-b007-1856394a8e94 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:07.627983 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1c87a3fe-6def-4a0c-b007-1856394a8e94 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1515 microversion: 2.1 time: 0.399528 Sep 06 16:21:07.628549 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 367/724] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:07 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1515 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:08.063331 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-76580d6a-75a9-4d08-8e7f-a8b0541a6843 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:08.064249 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-76580d6a-75a9-4d08-8e7f-a8b0541a6843 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:08.073097 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-76580d6a-75a9-4d08-8e7f-a8b0541a6843 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:08.074292 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-76580d6a-75a9-4d08-8e7f-a8b0541a6843 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:08.074733 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-76580d6a-75a9-4d08-8e7f-a8b0541a6843 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:08.075521 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-76580d6a-75a9-4d08-8e7f-a8b0541a6843 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:08.076118 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-76580d6a-75a9-4d08-8e7f-a8b0541a6843 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:08.076534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-76580d6a-75a9-4d08-8e7f-a8b0541a6843 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:08.220714 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-76580d6a-75a9-4d08-8e7f-a8b0541a6843 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:08.229751 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-76580d6a-75a9-4d08-8e7f-a8b0541a6843 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:08.231169 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-76580d6a-75a9-4d08-8e7f-a8b0541a6843 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:08.232456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-76580d6a-75a9-4d08-8e7f-a8b0541a6843 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.173862 Sep 06 16:21:08.233047 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 358/725] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:08 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:08.653288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-00083aaf-a2df-4f44-8f8b-1436cf38d0fe tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:08.654042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-00083aaf-a2df-4f44-8f8b-1436cf38d0fe tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:08.660843 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-00083aaf-a2df-4f44-8f8b-1436cf38d0fe tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:08.661330 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-00083aaf-a2df-4f44-8f8b-1436cf38d0fe tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:08.661754 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-00083aaf-a2df-4f44-8f8b-1436cf38d0fe tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:08.662437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-00083aaf-a2df-4f44-8f8b-1436cf38d0fe tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:08.662877 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-00083aaf-a2df-4f44-8f8b-1436cf38d0fe tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:08.663278 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-00083aaf-a2df-4f44-8f8b-1436cf38d0fe tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:08.800644 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-00083aaf-a2df-4f44-8f8b-1436cf38d0fe tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:08.809379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-00083aaf-a2df-4f44-8f8b-1436cf38d0fe tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1515 microversion: 2.1 time: 0.160159 Sep 06 16:21:08.810349 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 368/726] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:08 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:09.263744 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a2600d01-9e8e-4d79-8af2-8c87950387c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:09.264673 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a2600d01-9e8e-4d79-8af2-8c87950387c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:09.279495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a2600d01-9e8e-4d79-8af2-8c87950387c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:09.279495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a2600d01-9e8e-4d79-8af2-8c87950387c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:09.279495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a2600d01-9e8e-4d79-8af2-8c87950387c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:09.279901 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a2600d01-9e8e-4d79-8af2-8c87950387c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:09.280306 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a2600d01-9e8e-4d79-8af2-8c87950387c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:09.281988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a2600d01-9e8e-4d79-8af2-8c87950387c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:09.446990 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a2600d01-9e8e-4d79-8af2-8c87950387c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:09.457682 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a2600d01-9e8e-4d79-8af2-8c87950387c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:09.459100 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a2600d01-9e8e-4d79-8af2-8c87950387c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:09.460246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a2600d01-9e8e-4d79-8af2-8c87950387c6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.204830 Sep 06 16:21:09.460849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 359/727] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:09 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:09.835273 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4f763956-d1b6-4a1c-90b7-aaa176cb1fea tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:09.835866 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4f763956-d1b6-4a1c-90b7-aaa176cb1fea tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:09.843185 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4f763956-d1b6-4a1c-90b7-aaa176cb1fea tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:09.843663 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4f763956-d1b6-4a1c-90b7-aaa176cb1fea tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:09.844153 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4f763956-d1b6-4a1c-90b7-aaa176cb1fea tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:09.844923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4f763956-d1b6-4a1c-90b7-aaa176cb1fea tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:09.845575 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4f763956-d1b6-4a1c-90b7-aaa176cb1fea tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:09.846092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4f763956-d1b6-4a1c-90b7-aaa176cb1fea tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:09.993850 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4f763956-d1b6-4a1c-90b7-aaa176cb1fea tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:10.004005 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4f763956-d1b6-4a1c-90b7-aaa176cb1fea tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1515 microversion: 2.1 time: 0.172648 Sep 06 16:21:10.004670 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 369/728] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:09 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:10.491196 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f0531a48-3239-4033-9a65-221d8e306b1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:10.492156 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f0531a48-3239-4033-9a65-221d8e306b1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:10.499323 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f0531a48-3239-4033-9a65-221d8e306b1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:10.499832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f0531a48-3239-4033-9a65-221d8e306b1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:10.500316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f0531a48-3239-4033-9a65-221d8e306b1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:10.501046 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f0531a48-3239-4033-9a65-221d8e306b1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:10.501463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f0531a48-3239-4033-9a65-221d8e306b1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:10.501879 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f0531a48-3239-4033-9a65-221d8e306b1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:10.732477 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f0531a48-3239-4033-9a65-221d8e306b1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:10.742088 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f0531a48-3239-4033-9a65-221d8e306b1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:10.743637 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f0531a48-3239-4033-9a65-221d8e306b1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:10.744835 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f0531a48-3239-4033-9a65-221d8e306b1f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.259926 Sep 06 16:21:10.754438 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 360/729] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:10 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:11.038377 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d23e9c43-af29-4b76-b998-1902e5ae71a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:11.039333 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d23e9c43-af29-4b76-b998-1902e5ae71a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:11.042890 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:11.047205 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d23e9c43-af29-4b76-b998-1902e5ae71a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:11.047708 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d23e9c43-af29-4b76-b998-1902e5ae71a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:11.048213 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d23e9c43-af29-4b76-b998-1902e5ae71a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:11.048939 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d23e9c43-af29-4b76-b998-1902e5ae71a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:11.049562 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d23e9c43-af29-4b76-b998-1902e5ae71a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:11.050008 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d23e9c43-af29-4b76-b998-1902e5ae71a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:11.138693 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d23e9c43-af29-4b76-b998-1902e5ae71a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:11.151700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d23e9c43-af29-4b76-b998-1902e5ae71a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 200 len: 1473 microversion: 2.1 time: 0.117164 Sep 06 16:21:11.152944 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 370/730] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:11 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 1473 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:11.206178 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-ee97c548-f5d7-4860-806d-e0de314de5e7 req-70ecfa9d-f661-43c3-bda2-9b085d26aa6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e546ddd0-81de-42c6-8fbd-6d660af7feba", "name": "network-vif-deleted", "tag": "12e1e4c5-4f3a-4faf-9909-3984c992f9b6"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:11.223732 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-ee97c548-f5d7-4860-806d-e0de314de5e7 req-70ecfa9d-f661-43c3-bda2-9b085d26aa6c service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:11.224334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-ee97c548-f5d7-4860-806d-e0de314de5e7 req-70ecfa9d-f661-43c3-bda2-9b085d26aa6c service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:11.225117 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-ee97c548-f5d7-4860-806d-e0de314de5e7 req-70ecfa9d-f661-43c3-bda2-9b085d26aa6c service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:11.238275 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-ee97c548-f5d7-4860-806d-e0de314de5e7 req-70ecfa9d-f661-43c3-bda2-9b085d26aa6c service nova] Creating event network-vif-deleted:12e1e4c5-4f3a-4faf-9909-3984c992f9b6 for instance e546ddd0-81de-42c6-8fbd-6d660af7feba on hv-cinder-85221 Sep 06 16:21:11.248742 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-ee97c548-f5d7-4860-806d-e0de314de5e7 req-70ecfa9d-f661-43c3-bda2-9b085d26aa6c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049444 Sep 06 16:21:11.250403 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 361/731] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:21:11.772156 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-dd4ea455-542c-4fdd-91b7-3b72e05d4b79 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:11.772779 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-dd4ea455-542c-4fdd-91b7-3b72e05d4b79 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:11.780224 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dd4ea455-542c-4fdd-91b7-3b72e05d4b79 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:11.780708 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dd4ea455-542c-4fdd-91b7-3b72e05d4b79 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:11.781173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dd4ea455-542c-4fdd-91b7-3b72e05d4b79 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:11.781882 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dd4ea455-542c-4fdd-91b7-3b72e05d4b79 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:11.782519 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dd4ea455-542c-4fdd-91b7-3b72e05d4b79 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:11.782939 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dd4ea455-542c-4fdd-91b7-3b72e05d4b79 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:11.926531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dd4ea455-542c-4fdd-91b7-3b72e05d4b79 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:11.941816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dd4ea455-542c-4fdd-91b7-3b72e05d4b79 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:11.943321 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dd4ea455-542c-4fdd-91b7-3b72e05d4b79 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:11.944484 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-dd4ea455-542c-4fdd-91b7-3b72e05d4b79 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.176628 Sep 06 16:21:11.945055 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 371/732] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:11 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:12.178748 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-672a2604-4342-40f0-934a-7c726a79d0a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:12.180149 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-672a2604-4342-40f0-934a-7c726a79d0a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: e546ddd0-81de-42c6-8fbd-6d660af7feba] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:12.187683 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-672a2604-4342-40f0-934a-7c726a79d0a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:12.188256 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-672a2604-4342-40f0-934a-7c726a79d0a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:12.188670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-672a2604-4342-40f0-934a-7c726a79d0a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:12.189345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-672a2604-4342-40f0-934a-7c726a79d0a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:12.189988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-672a2604-4342-40f0-934a-7c726a79d0a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:12.190405 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-672a2604-4342-40f0-934a-7c726a79d0a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:12.217326 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-672a2604-4342-40f0-934a-7c726a79d0a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] HTTP exception thrown: Instance e546ddd0-81de-42c6-8fbd-6d660af7feba could not be found. Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-672a2604-4342-40f0-934a-7c726a79d0a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Request method failure captured: Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba HTTP/1.1 Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3LxKsFeHz7CUnTLvjspclPwmUSy-f3zj094rK785iBT6QTMZYxZ-8PIffWLpbNBn_I8E8XlhuClHMAfcxIsSVjwMBLyAvbMD8VPNlRgN10EjP-c69IV-wPeH721pop21zGRqsHUms0g3UmcPlvaRkJ-zXMzmNm-BnI7uynvLdr5AO8 Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 89e0b5bdccf44702b0490185476f88b3 Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesSnapshotTestJSON-198087087 Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:21:12.219406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:21:12.221101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89e0b5bdccf44702b0490185476f88b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89e0b5bdccf44702b0490185476f88b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_89e0b5bdccf44702b0490185476f88b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/89e0b5bdccf44702b0490185476f88b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:21:12.221101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesSnapshotTestJSON-198087087 Sep 06 16:21:12.221101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 89e0b5bdccf44702b0490185476f88b3 Sep 06 16:21:12.221101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-198087087 Sep 06 16:21:12.221101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesSnapshotTestJSON-198087087-project Sep 06 16:21:12.221101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:21:12.221101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:21:12.221101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: fd9a6286db4945d4a052c40a5242d409 Sep 06 16:21:12.221101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesSnapshotTestJSON-198087087-project Sep 06 16:21:12.221101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:21:12.221101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance e546ddd0-81de-42c6-8fbd-6d660af7feba could not be found. Sep 06 16:21:12.221101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'e546ddd0-81de-42c6-8fbd-6d660af7feba'} Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e546ddd0-81de-42c6-8fbd-6d660af7feba could not be found. Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:21:12.221896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e546ddd0-81de-42c6-8fbd-6d660af7feba could not be found. Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e546ddd0-81de-42c6-8fbd-6d660af7feba could not be found. Sep 06 16:21:12.223167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:21:12.224323 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-672a2604-4342-40f0-934a-7c726a79d0a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Returning 404 to user: Instance e546ddd0-81de-42c6-8fbd-6d660af7feba could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:21:12.224323 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-672a2604-4342-40f0-934a-7c726a79d0a5 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba" status: 404 len: 111 microversion: 2.1 time: 0.047607 Sep 06 16:21:12.224323 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 362/733] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:12 2022] GET /compute/v2.1/servers/e546ddd0-81de-42c6-8fbd-6d660af7feba => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:21:12.969711 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2b368d22-8dec-47b7-994e-869108d4efca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:12.970434 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2b368d22-8dec-47b7-994e-869108d4efca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:12.978553 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b368d22-8dec-47b7-994e-869108d4efca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:12.979089 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b368d22-8dec-47b7-994e-869108d4efca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:12.979700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b368d22-8dec-47b7-994e-869108d4efca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:12.980441 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b368d22-8dec-47b7-994e-869108d4efca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:12.980927 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b368d22-8dec-47b7-994e-869108d4efca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:12.981367 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b368d22-8dec-47b7-994e-869108d4efca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:13.120111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2b368d22-8dec-47b7-994e-869108d4efca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:13.130346 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2b368d22-8dec-47b7-994e-869108d4efca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:13.131764 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2b368d22-8dec-47b7-994e-869108d4efca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:13.132965 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2b368d22-8dec-47b7-994e-869108d4efca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.167321 Sep 06 16:21:13.133557 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 372/734] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:12 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:13.559252 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-575798115", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452"}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:13.627988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] validate_networks() for None {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:21:14.161676 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f599dadb-a949-400e-ae64-268d5726fee8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:14.162364 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f599dadb-a949-400e-ae64-268d5726fee8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:14.168986 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f599dadb-a949-400e-ae64-268d5726fee8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:14.169476 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f599dadb-a949-400e-ae64-268d5726fee8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:14.169905 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f599dadb-a949-400e-ae64-268d5726fee8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:14.170645 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f599dadb-a949-400e-ae64-268d5726fee8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:14.171094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f599dadb-a949-400e-ae64-268d5726fee8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:14.171520 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f599dadb-a949-400e-ae64-268d5726fee8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:14.181864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:21:14.182329 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:21:14.183233 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:21:14.183641 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:21:14.184160 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:21:14.194376 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:14.194860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:14.195288 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:14.196001 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:14.196444 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:14.196886 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:14.218411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Getting quotas for project 34c5034fbe9f4d2e9ee9c372dee6f2e6. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:21:14.222479 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Getting quotas for user 42904081b7f74a3887e8ecb8e59b10c2 and project 34c5034fbe9f4d2e9ee9c372dee6f2e6. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:21:14.233575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:21:14.235907 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:21:14.289391 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7cffa68e-92ad-46a9-b2d6-dbf6a8ee9d60 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734022 Sep 06 16:21:14.292887 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 363/735] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:21:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:21:14.301870 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-95198c98-2eb1-4035-abff-0819e5c90b51 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:14.302268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-95198c98-2eb1-4035-abff-0819e5c90b51 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:14.330865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f599dadb-a949-400e-ae64-268d5726fee8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:14.342084 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f599dadb-a949-400e-ae64-268d5726fee8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:14.342519 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f599dadb-a949-400e-ae64-268d5726fee8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:14.343841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f599dadb-a949-400e-ae64-268d5726fee8 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.186300 Sep 06 16:21:14.344518 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 373/736] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:14 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:21:14.367237 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-95198c98-2eb1-4035-abff-0819e5c90b51 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:14.376867 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-95198c98-2eb1-4035-abff-0819e5c90b51 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1214 microversion: 2.1 time: 0.078977 Sep 06 16:21:14.377987 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 364/737] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:14 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:15.370571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-679e5399-57a4-4956-aae5-3053884a9ffd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:15.371266 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-679e5399-57a4-4956-aae5-3053884a9ffd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:15.378578 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-679e5399-57a4-4956-aae5-3053884a9ffd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:15.379063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-679e5399-57a4-4956-aae5-3053884a9ffd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:15.379488 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-679e5399-57a4-4956-aae5-3053884a9ffd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:15.380165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-679e5399-57a4-4956-aae5-3053884a9ffd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:15.380598 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-679e5399-57a4-4956-aae5-3053884a9ffd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:15.381052 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-679e5399-57a4-4956-aae5-3053884a9ffd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:15.400559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e9b7bc25-3ebd-4a2a-8348-d4070ba9ffc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:15.401199 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e9b7bc25-3ebd-4a2a-8348-d4070ba9ffc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:15.410353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9b7bc25-3ebd-4a2a-8348-d4070ba9ffc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:15.411160 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9b7bc25-3ebd-4a2a-8348-d4070ba9ffc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:15.411688 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9b7bc25-3ebd-4a2a-8348-d4070ba9ffc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:15.412970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9b7bc25-3ebd-4a2a-8348-d4070ba9ffc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:15.413762 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9b7bc25-3ebd-4a2a-8348-d4070ba9ffc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:15.414522 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e9b7bc25-3ebd-4a2a-8348-d4070ba9ffc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:15.487158 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e9b7bc25-3ebd-4a2a-8348-d4070ba9ffc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:15.496396 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e9b7bc25-3ebd-4a2a-8348-d4070ba9ffc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1218 microversion: 2.1 time: 0.099919 Sep 06 16:21:15.497327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 365/738] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:15 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:15.535506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-679e5399-57a4-4956-aae5-3053884a9ffd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:15.544602 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-679e5399-57a4-4956-aae5-3053884a9ffd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:15.546078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-679e5399-57a4-4956-aae5-3053884a9ffd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:15.547232 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-679e5399-57a4-4956-aae5-3053884a9ffd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.180609 Sep 06 16:21:15.547995 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 374/739] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:15 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:16.522993 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0d224ae7-f77b-4bf1-a1ba-2d834925d58b tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:16.523586 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0d224ae7-f77b-4bf1-a1ba-2d834925d58b tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:16.530287 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d224ae7-f77b-4bf1-a1ba-2d834925d58b tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:16.530764 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d224ae7-f77b-4bf1-a1ba-2d834925d58b tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:16.531221 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d224ae7-f77b-4bf1-a1ba-2d834925d58b tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:16.531916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d224ae7-f77b-4bf1-a1ba-2d834925d58b tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:16.532372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d224ae7-f77b-4bf1-a1ba-2d834925d58b tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:16.532790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0d224ae7-f77b-4bf1-a1ba-2d834925d58b tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:16.575367 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-379f50c4-eb79-492a-9826-ebed7af53ed6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:16.575974 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-379f50c4-eb79-492a-9826-ebed7af53ed6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:16.584004 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-379f50c4-eb79-492a-9826-ebed7af53ed6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:16.584551 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-379f50c4-eb79-492a-9826-ebed7af53ed6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:16.585004 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-379f50c4-eb79-492a-9826-ebed7af53ed6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:16.585805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-379f50c4-eb79-492a-9826-ebed7af53ed6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:16.586256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-379f50c4-eb79-492a-9826-ebed7af53ed6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:16.586758 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-379f50c4-eb79-492a-9826-ebed7af53ed6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:16.614409 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0d224ae7-f77b-4bf1-a1ba-2d834925d58b tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:16.622925 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0d224ae7-f77b-4bf1-a1ba-2d834925d58b tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1210 microversion: 2.1 time: 0.103942 Sep 06 16:21:16.623506 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 366/740] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:16 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:16.735817 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-379f50c4-eb79-492a-9826-ebed7af53ed6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:16.745116 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-379f50c4-eb79-492a-9826-ebed7af53ed6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:16.746531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-379f50c4-eb79-492a-9826-ebed7af53ed6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:16.747685 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-379f50c4-eb79-492a-9826-ebed7af53ed6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.176862 Sep 06 16:21:16.748232 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 375/741] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:16 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:21:17.647578 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-67d25976-d49b-415c-970f-8f706a7eb1db tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:17.648132 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-67d25976-d49b-415c-970f-8f706a7eb1db tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:17.655480 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67d25976-d49b-415c-970f-8f706a7eb1db tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:17.656192 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67d25976-d49b-415c-970f-8f706a7eb1db tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:17.656609 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67d25976-d49b-415c-970f-8f706a7eb1db tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:17.657364 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67d25976-d49b-415c-970f-8f706a7eb1db tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:17.657821 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67d25976-d49b-415c-970f-8f706a7eb1db tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:17.658244 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-67d25976-d49b-415c-970f-8f706a7eb1db tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:17.722640 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-67d25976-d49b-415c-970f-8f706a7eb1db tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:17.731141 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-67d25976-d49b-415c-970f-8f706a7eb1db tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1210 microversion: 2.1 time: 0.087480 Sep 06 16:21:17.731866 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 367/742] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:17 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:17.773078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-dea82457-ebb4-415e-8d77-05fb9efa7a47 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:17.773840 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-dea82457-ebb4-415e-8d77-05fb9efa7a47 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:17.780491 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dea82457-ebb4-415e-8d77-05fb9efa7a47 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:17.781058 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dea82457-ebb4-415e-8d77-05fb9efa7a47 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:17.781487 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dea82457-ebb4-415e-8d77-05fb9efa7a47 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:17.782177 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dea82457-ebb4-415e-8d77-05fb9efa7a47 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:17.782620 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dea82457-ebb4-415e-8d77-05fb9efa7a47 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:17.783031 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dea82457-ebb4-415e-8d77-05fb9efa7a47 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:17.925193 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dea82457-ebb4-415e-8d77-05fb9efa7a47 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:17.937008 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dea82457-ebb4-415e-8d77-05fb9efa7a47 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:17.939997 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dea82457-ebb4-415e-8d77-05fb9efa7a47 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:17.942522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-dea82457-ebb4-415e-8d77-05fb9efa7a47 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.173314 Sep 06 16:21:17.943124 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 376/743] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:17 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:18.618288 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-e0e22115-eb76-481e-b873-b7123c711223 req-55cb7912-f7b2-4a83-bc38-60dd30d8579d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2", "name": "network-vif-plugged", "status": "completed", "tag": "4b0a3d0f-c85a-40a8-b906-23e0735edd5e"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:18.628653 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-e0e22115-eb76-481e-b873-b7123c711223 req-55cb7912-f7b2-4a83-bc38-60dd30d8579d service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:18.629441 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-e0e22115-eb76-481e-b873-b7123c711223 req-55cb7912-f7b2-4a83-bc38-60dd30d8579d service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:18.629999 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-e0e22115-eb76-481e-b873-b7123c711223 req-55cb7912-f7b2-4a83-bc38-60dd30d8579d service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:18.643884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-e0e22115-eb76-481e-b873-b7123c711223 req-55cb7912-f7b2-4a83-bc38-60dd30d8579d service nova] Creating event network-vif-plugged:4b0a3d0f-c85a-40a8-b906-23e0735edd5e for instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 on hv-cinder-85221 Sep 06 16:21:18.650372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-e0e22115-eb76-481e-b873-b7123c711223 req-55cb7912-f7b2-4a83-bc38-60dd30d8579d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035258 Sep 06 16:21:18.651319 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 368/744] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:21:18.755198 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f3147cd8-555c-48bc-94c3-dce3743c8020 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:18.756128 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f3147cd8-555c-48bc-94c3-dce3743c8020 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:18.764441 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3147cd8-555c-48bc-94c3-dce3743c8020 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:18.772041 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3147cd8-555c-48bc-94c3-dce3743c8020 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:18.772648 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3147cd8-555c-48bc-94c3-dce3743c8020 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:18.773651 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3147cd8-555c-48bc-94c3-dce3743c8020 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:18.774219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3147cd8-555c-48bc-94c3-dce3743c8020 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:18.774610 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3147cd8-555c-48bc-94c3-dce3743c8020 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:18.873323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f3147cd8-555c-48bc-94c3-dce3743c8020 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:18.885591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f3147cd8-555c-48bc-94c3-dce3743c8020 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1284 microversion: 2.1 time: 0.135203 Sep 06 16:21:18.886535 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 377/745] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:18 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:18.968598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cba51f81-e25f-4521-aa58-af6b26f801cc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:18.969324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cba51f81-e25f-4521-aa58-af6b26f801cc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:18.975781 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cba51f81-e25f-4521-aa58-af6b26f801cc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:18.976262 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cba51f81-e25f-4521-aa58-af6b26f801cc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:18.976693 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cba51f81-e25f-4521-aa58-af6b26f801cc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:18.977483 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cba51f81-e25f-4521-aa58-af6b26f801cc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:18.977927 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cba51f81-e25f-4521-aa58-af6b26f801cc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:18.978346 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cba51f81-e25f-4521-aa58-af6b26f801cc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:19.125623 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cba51f81-e25f-4521-aa58-af6b26f801cc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:19.135197 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cba51f81-e25f-4521-aa58-af6b26f801cc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:19.136969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cba51f81-e25f-4521-aa58-af6b26f801cc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:19.138139 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cba51f81-e25f-4521-aa58-af6b26f801cc tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.174369 Sep 06 16:21:19.138701 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 369/746] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:18 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:19.909981 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ea39d343-8ae4-41c7-a8ab-59a6c5109e4f tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:19.910664 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ea39d343-8ae4-41c7-a8ab-59a6c5109e4f tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:19.917542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea39d343-8ae4-41c7-a8ab-59a6c5109e4f tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:19.918038 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea39d343-8ae4-41c7-a8ab-59a6c5109e4f tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:19.918438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea39d343-8ae4-41c7-a8ab-59a6c5109e4f tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:19.919164 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea39d343-8ae4-41c7-a8ab-59a6c5109e4f tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:19.919800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea39d343-8ae4-41c7-a8ab-59a6c5109e4f tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:19.920226 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea39d343-8ae4-41c7-a8ab-59a6c5109e4f tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:19.996373 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ea39d343-8ae4-41c7-a8ab-59a6c5109e4f tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:20.010130 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ea39d343-8ae4-41c7-a8ab-59a6c5109e4f tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1272 microversion: 2.1 time: 0.104599 Sep 06 16:21:20.010767 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 378/747] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:19 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:20.167302 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3ed15365-34c0-4f8e-a1ad-6232032d89ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:20.167997 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-3ed15365-34c0-4f8e-a1ad-6232032d89ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:20.175819 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3ed15365-34c0-4f8e-a1ad-6232032d89ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:20.176293 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3ed15365-34c0-4f8e-a1ad-6232032d89ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:20.176818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3ed15365-34c0-4f8e-a1ad-6232032d89ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:20.177717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3ed15365-34c0-4f8e-a1ad-6232032d89ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:20.188261 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3ed15365-34c0-4f8e-a1ad-6232032d89ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:20.188996 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3ed15365-34c0-4f8e-a1ad-6232032d89ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:20.446562 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3ed15365-34c0-4f8e-a1ad-6232032d89ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:20.457071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3ed15365-34c0-4f8e-a1ad-6232032d89ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:20.459135 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3ed15365-34c0-4f8e-a1ad-6232032d89ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:20.460347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-3ed15365-34c0-4f8e-a1ad-6232032d89ca tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.297800 Sep 06 16:21:20.460982 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 370/748] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:20 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:20.992490 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-d53533bc-3636-4d0f-b761-96a5e5c49d2b req-85b94698-bc8b-4538-aecf-c4a87ee9a1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0703f63d-6ac9-4219-ac90-170280a05cf0", "tag": "73edccbd-1423-4fbf-a674-eaa6d1d6f849"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:21.003389 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-d53533bc-3636-4d0f-b761-96a5e5c49d2b req-85b94698-bc8b-4538-aecf-c4a87ee9a1cc service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:21.003857 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-d53533bc-3636-4d0f-b761-96a5e5c49d2b req-85b94698-bc8b-4538-aecf-c4a87ee9a1cc service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:21.004274 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-d53533bc-3636-4d0f-b761-96a5e5c49d2b req-85b94698-bc8b-4538-aecf-c4a87ee9a1cc service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:21.016703 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-d53533bc-3636-4d0f-b761-96a5e5c49d2b req-85b94698-bc8b-4538-aecf-c4a87ee9a1cc service nova] Creating event network-changed:73edccbd-1423-4fbf-a674-eaa6d1d6f849 for instance 0703f63d-6ac9-4219-ac90-170280a05cf0 on hv-cinder-85221 Sep 06 16:21:21.021945 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-d53533bc-3636-4d0f-b761-96a5e5c49d2b req-85b94698-bc8b-4538-aecf-c4a87ee9a1cc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033486 Sep 06 16:21:21.022772 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 379/749] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:21:21.033069 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-025218b8-e5b0-4367-bdc1-8e3fca9ab189 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:21.033775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-025218b8-e5b0-4367-bdc1-8e3fca9ab189 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:21.040292 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-025218b8-e5b0-4367-bdc1-8e3fca9ab189 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:21.040804 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-025218b8-e5b0-4367-bdc1-8e3fca9ab189 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:21.042052 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-025218b8-e5b0-4367-bdc1-8e3fca9ab189 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:21.043450 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-025218b8-e5b0-4367-bdc1-8e3fca9ab189 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:21.043951 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-025218b8-e5b0-4367-bdc1-8e3fca9ab189 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:21.044487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-025218b8-e5b0-4367-bdc1-8e3fca9ab189 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:21.193702 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-025218b8-e5b0-4367-bdc1-8e3fca9ab189 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:21.204707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-025218b8-e5b0-4367-bdc1-8e3fca9ab189 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.175441 Sep 06 16:21:21.205307 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 371/750] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:21 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:21.495805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fb514d12-7deb-4b9f-a2f7-6564faebff16 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:21.496383 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fb514d12-7deb-4b9f-a2f7-6564faebff16 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:21.504110 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb514d12-7deb-4b9f-a2f7-6564faebff16 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:21.504596 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb514d12-7deb-4b9f-a2f7-6564faebff16 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:21.505065 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb514d12-7deb-4b9f-a2f7-6564faebff16 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:21.505765 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb514d12-7deb-4b9f-a2f7-6564faebff16 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:21.506214 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb514d12-7deb-4b9f-a2f7-6564faebff16 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:21.506608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb514d12-7deb-4b9f-a2f7-6564faebff16 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:21.644006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fb514d12-7deb-4b9f-a2f7-6564faebff16 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:21.656860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fb514d12-7deb-4b9f-a2f7-6564faebff16 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:21.658293 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fb514d12-7deb-4b9f-a2f7-6564faebff16 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:21.659489 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fb514d12-7deb-4b9f-a2f7-6564faebff16 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.168114 Sep 06 16:21:21.660080 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 380/751] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:21 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:22.227405 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e18bc507-c9f9-4bb5-b410-48507e6d9f95 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:22.227992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e18bc507-c9f9-4bb5-b410-48507e6d9f95 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:22.234890 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e18bc507-c9f9-4bb5-b410-48507e6d9f95 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:22.235364 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e18bc507-c9f9-4bb5-b410-48507e6d9f95 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:22.235771 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e18bc507-c9f9-4bb5-b410-48507e6d9f95 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:22.236458 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e18bc507-c9f9-4bb5-b410-48507e6d9f95 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:22.236933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e18bc507-c9f9-4bb5-b410-48507e6d9f95 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:22.237359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e18bc507-c9f9-4bb5-b410-48507e6d9f95 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:22.387802 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e18bc507-c9f9-4bb5-b410-48507e6d9f95 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:22.395880 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e18bc507-c9f9-4bb5-b410-48507e6d9f95 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.172320 Sep 06 16:21:22.396780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 372/752] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:22 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:22.688553 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e907060c-3b5f-4383-b107-33f0cda13c3f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:22.689375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e907060c-3b5f-4383-b107-33f0cda13c3f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:22.698147 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e907060c-3b5f-4383-b107-33f0cda13c3f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:22.698832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e907060c-3b5f-4383-b107-33f0cda13c3f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:22.699452 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e907060c-3b5f-4383-b107-33f0cda13c3f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:22.700560 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e907060c-3b5f-4383-b107-33f0cda13c3f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:22.701169 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e907060c-3b5f-4383-b107-33f0cda13c3f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:22.701790 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e907060c-3b5f-4383-b107-33f0cda13c3f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:22.855304 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e907060c-3b5f-4383-b107-33f0cda13c3f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:22.868906 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e907060c-3b5f-4383-b107-33f0cda13c3f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:22.871172 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e907060c-3b5f-4383-b107-33f0cda13c3f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:22.872973 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e907060c-3b5f-4383-b107-33f0cda13c3f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.189405 Sep 06 16:21:22.873799 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 381/753] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:22 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:23.421009 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-90e97568-551e-4e0e-ad96-78aef09ccfd7 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:23.421653 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-90e97568-551e-4e0e-ad96-78aef09ccfd7 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:23.428600 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-90e97568-551e-4e0e-ad96-78aef09ccfd7 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:23.429111 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-90e97568-551e-4e0e-ad96-78aef09ccfd7 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:23.429546 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-90e97568-551e-4e0e-ad96-78aef09ccfd7 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:23.430260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-90e97568-551e-4e0e-ad96-78aef09ccfd7 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:23.430703 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-90e97568-551e-4e0e-ad96-78aef09ccfd7 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:23.431119 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-90e97568-551e-4e0e-ad96-78aef09ccfd7 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:23.454167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:23.573912 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-90e97568-551e-4e0e-ad96-78aef09ccfd7 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:23.581911 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-90e97568-551e-4e0e-ad96-78aef09ccfd7 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.166800 Sep 06 16:21:23.582472 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 373/754] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:23 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:23.899005 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ed947f17-88b1-42b0-8c05-3a6f981616aa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:23.899564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ed947f17-88b1-42b0-8c05-3a6f981616aa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:23.906255 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed947f17-88b1-42b0-8c05-3a6f981616aa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:23.906733 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed947f17-88b1-42b0-8c05-3a6f981616aa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:23.907163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed947f17-88b1-42b0-8c05-3a6f981616aa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:23.907843 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed947f17-88b1-42b0-8c05-3a6f981616aa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:23.908287 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed947f17-88b1-42b0-8c05-3a6f981616aa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:23.908693 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ed947f17-88b1-42b0-8c05-3a6f981616aa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:24.051704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ed947f17-88b1-42b0-8c05-3a6f981616aa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:24.065341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ed947f17-88b1-42b0-8c05-3a6f981616aa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:24.068246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ed947f17-88b1-42b0-8c05-3a6f981616aa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:24.068615 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ed947f17-88b1-42b0-8c05-3a6f981616aa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.173671 Sep 06 16:21:24.069307 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 382/755] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:23 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:21:24.607959 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-dde682f8-3486-4a26-a8df-0b416009cd79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:24.609652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-dde682f8-3486-4a26-a8df-0b416009cd79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:24.612544 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:24.613751 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=8 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:24.620572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dde682f8-3486-4a26-a8df-0b416009cd79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:24.621068 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dde682f8-3486-4a26-a8df-0b416009cd79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:24.621497 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dde682f8-3486-4a26-a8df-0b416009cd79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:24.622182 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dde682f8-3486-4a26-a8df-0b416009cd79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:24.622612 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dde682f8-3486-4a26-a8df-0b416009cd79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:24.623024 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dde682f8-3486-4a26-a8df-0b416009cd79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:24.771489 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-dde682f8-3486-4a26-a8df-0b416009cd79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:24.779813 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-dde682f8-3486-4a26-a8df-0b416009cd79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.178620 Sep 06 16:21:24.780425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 374/756] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:24 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:25.095915 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-025fdb49-f197-4210-908e-86ce940c5be3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:25.096711 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-025fdb49-f197-4210-908e-86ce940c5be3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:25.106398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-025fdb49-f197-4210-908e-86ce940c5be3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:25.107050 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-025fdb49-f197-4210-908e-86ce940c5be3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:25.107483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-025fdb49-f197-4210-908e-86ce940c5be3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:25.108950 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-025fdb49-f197-4210-908e-86ce940c5be3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:25.109393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-025fdb49-f197-4210-908e-86ce940c5be3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:25.109812 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-025fdb49-f197-4210-908e-86ce940c5be3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:25.250361 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-025fdb49-f197-4210-908e-86ce940c5be3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:25.255170 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:25.261491 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-025fdb49-f197-4210-908e-86ce940c5be3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:25.262916 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-025fdb49-f197-4210-908e-86ce940c5be3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:25.264079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-025fdb49-f197-4210-908e-86ce940c5be3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.172625 Sep 06 16:21:25.264634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 383/757] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:25 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:25.467123 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-673909736", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "networks": [{"uuid": "d1957dec-f3c3-45b6-aec6-f7cdd6e748ae"}]}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:25.521288 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] validate_networks() for [('d1957dec-f3c3-45b6-aec6-f7cdd6e748ae', None, None, None, None, None)] {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:21:25.810198 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-196b7220-63bb-40f0-95c6-eae507db892e tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:25.810833 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-196b7220-63bb-40f0-95c6-eae507db892e tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:25.817696 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-196b7220-63bb-40f0-95c6-eae507db892e tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:25.818169 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-196b7220-63bb-40f0-95c6-eae507db892e tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:25.818594 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-196b7220-63bb-40f0-95c6-eae507db892e tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:25.819321 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-196b7220-63bb-40f0-95c6-eae507db892e tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:25.819724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-196b7220-63bb-40f0-95c6-eae507db892e tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:25.820245 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-196b7220-63bb-40f0-95c6-eae507db892e tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:25.958561 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-196b7220-63bb-40f0-95c6-eae507db892e tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:25.966887 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-196b7220-63bb-40f0-95c6-eae507db892e tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.161195 Sep 06 16:21:25.967472 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 384/758] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:25 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:26.002850 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:21:26.003357 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:21:26.003735 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:21:26.004269 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:21:26.004684 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:21:26.015744 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:26.016229 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:26.016667 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:26.017413 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:26.017858 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:26.018279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:26.037966 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Getting quotas for project 89e0b5bdccf44702b0490185476f88b3. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:21:26.043677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Getting quotas for user fd9a6286db4945d4a052c40a5242d409 and project 89e0b5bdccf44702b0490185476f88b3. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:21:26.056564 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:21:26.059377 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:21:26.114861 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d7b0bdcc-50d7-40e6-a736-058a45f6a46a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651514 Sep 06 16:21:26.116060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 375/759] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:21:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:21:26.130277 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f53b0024-d096-4261-aa96-5e4e9dcf9475 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:26.131395 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f53b0024-d096-4261-aa96-5e4e9dcf9475 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:26.198668 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f53b0024-d096-4261-aa96-5e4e9dcf9475 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:26.208203 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f53b0024-d096-4261-aa96-5e4e9dcf9475 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1218 microversion: 2.1 time: 0.085028 Sep 06 16:21:26.220488 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 385/760] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:26 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:26.294860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-bfb483cf-7866-456f-8b25-cf6bdd0a827c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:26.295567 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-bfb483cf-7866-456f-8b25-cf6bdd0a827c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:26.303909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bfb483cf-7866-456f-8b25-cf6bdd0a827c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:26.304255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bfb483cf-7866-456f-8b25-cf6bdd0a827c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:26.304701 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bfb483cf-7866-456f-8b25-cf6bdd0a827c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:26.305454 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bfb483cf-7866-456f-8b25-cf6bdd0a827c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:26.305907 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bfb483cf-7866-456f-8b25-cf6bdd0a827c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:26.306418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bfb483cf-7866-456f-8b25-cf6bdd0a827c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:26.494797 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-bfb483cf-7866-456f-8b25-cf6bdd0a827c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:26.507888 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-bfb483cf-7866-456f-8b25-cf6bdd0a827c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:26.509968 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-bfb483cf-7866-456f-8b25-cf6bdd0a827c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:26.511467 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-bfb483cf-7866-456f-8b25-cf6bdd0a827c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.225991 Sep 06 16:21:26.512143 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 376/761] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:26 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:26.993285 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9acb57a6-6013-42e1-8f0e-1bf0b24d68e9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:26.994055 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9acb57a6-6013-42e1-8f0e-1bf0b24d68e9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:27.002581 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9acb57a6-6013-42e1-8f0e-1bf0b24d68e9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:27.003281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9acb57a6-6013-42e1-8f0e-1bf0b24d68e9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:27.003788 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9acb57a6-6013-42e1-8f0e-1bf0b24d68e9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:27.004475 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9acb57a6-6013-42e1-8f0e-1bf0b24d68e9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:27.004920 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9acb57a6-6013-42e1-8f0e-1bf0b24d68e9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:27.005643 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9acb57a6-6013-42e1-8f0e-1bf0b24d68e9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:27.145349 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9acb57a6-6013-42e1-8f0e-1bf0b24d68e9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:27.154559 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9acb57a6-6013-42e1-8f0e-1bf0b24d68e9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.167854 Sep 06 16:21:27.155125 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 386/762] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:26 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:27.231580 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-09919fdb-07af-4464-aa5f-de70336e5ceb tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:27.232155 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-09919fdb-07af-4464-aa5f-de70336e5ceb tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:27.239329 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-09919fdb-07af-4464-aa5f-de70336e5ceb tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:27.239793 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-09919fdb-07af-4464-aa5f-de70336e5ceb tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:27.240247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-09919fdb-07af-4464-aa5f-de70336e5ceb tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:27.240979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-09919fdb-07af-4464-aa5f-de70336e5ceb tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:27.241431 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-09919fdb-07af-4464-aa5f-de70336e5ceb tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:27.241853 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-09919fdb-07af-4464-aa5f-de70336e5ceb tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:27.309906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-09919fdb-07af-4464-aa5f-de70336e5ceb tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:27.318302 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-09919fdb-07af-4464-aa5f-de70336e5ceb tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1222 microversion: 2.1 time: 0.090599 Sep 06 16:21:27.318957 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 377/763] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:27 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:27.540150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2de6de5d-2f71-4c15-ac2f-6883f62fb2a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:27.540652 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2de6de5d-2f71-4c15-ac2f-6883f62fb2a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:27.547398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2de6de5d-2f71-4c15-ac2f-6883f62fb2a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:27.547914 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2de6de5d-2f71-4c15-ac2f-6883f62fb2a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:27.548341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2de6de5d-2f71-4c15-ac2f-6883f62fb2a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:27.549055 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2de6de5d-2f71-4c15-ac2f-6883f62fb2a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:27.549502 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2de6de5d-2f71-4c15-ac2f-6883f62fb2a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:27.549920 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2de6de5d-2f71-4c15-ac2f-6883f62fb2a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:27.694174 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2de6de5d-2f71-4c15-ac2f-6883f62fb2a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:27.707957 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2de6de5d-2f71-4c15-ac2f-6883f62fb2a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:27.709426 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2de6de5d-2f71-4c15-ac2f-6883f62fb2a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:27.710560 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2de6de5d-2f71-4c15-ac2f-6883f62fb2a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.174652 Sep 06 16:21:27.711118 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 387/764] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:27 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:28.181228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4ab0f120-94c1-4685-8b53-4b445449ec79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:28.181958 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4ab0f120-94c1-4685-8b53-4b445449ec79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:28.189637 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ab0f120-94c1-4685-8b53-4b445449ec79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:28.190332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ab0f120-94c1-4685-8b53-4b445449ec79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:28.190950 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ab0f120-94c1-4685-8b53-4b445449ec79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:28.191795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ab0f120-94c1-4685-8b53-4b445449ec79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:28.192246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ab0f120-94c1-4685-8b53-4b445449ec79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:28.192691 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4ab0f120-94c1-4685-8b53-4b445449ec79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:28.330854 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4ab0f120-94c1-4685-8b53-4b445449ec79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:28.339894 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4ab0f120-94c1-4685-8b53-4b445449ec79 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.165200 Sep 06 16:21:28.340658 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 378/765] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:28 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:28.341887 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-586067e4-afa8-4401-bcfe-c47e923df46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:28.342483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-586067e4-afa8-4401-bcfe-c47e923df46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:28.349126 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-586067e4-afa8-4401-bcfe-c47e923df46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:28.349541 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-586067e4-afa8-4401-bcfe-c47e923df46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:28.349965 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-586067e4-afa8-4401-bcfe-c47e923df46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:28.350674 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-586067e4-afa8-4401-bcfe-c47e923df46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:28.351115 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-586067e4-afa8-4401-bcfe-c47e923df46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:28.351533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-586067e4-afa8-4401-bcfe-c47e923df46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:28.417459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-586067e4-afa8-4401-bcfe-c47e923df46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:28.428860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-586067e4-afa8-4401-bcfe-c47e923df46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1222 microversion: 2.1 time: 0.090740 Sep 06 16:21:28.429434 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 388/766] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:28 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:28.740648 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f6869924-2486-4ae1-bfb2-a667a858d3bb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:28.741696 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f6869924-2486-4ae1-bfb2-a667a858d3bb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:28.752196 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f6869924-2486-4ae1-bfb2-a667a858d3bb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:28.753062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f6869924-2486-4ae1-bfb2-a667a858d3bb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:28.753936 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f6869924-2486-4ae1-bfb2-a667a858d3bb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:28.754641 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f6869924-2486-4ae1-bfb2-a667a858d3bb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:28.755087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f6869924-2486-4ae1-bfb2-a667a858d3bb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:28.755496 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f6869924-2486-4ae1-bfb2-a667a858d3bb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:28.918916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f6869924-2486-4ae1-bfb2-a667a858d3bb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:28.932927 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f6869924-2486-4ae1-bfb2-a667a858d3bb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:28.935226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f6869924-2486-4ae1-bfb2-a667a858d3bb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:28.937032 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f6869924-2486-4ae1-bfb2-a667a858d3bb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1808 microversion: 2.20 time: 0.202915 Sep 06 16:21:28.937777 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 379/767] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:28 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:29.362932 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-8e9a1a51-0239-42c5-b428-b9a69c80da58 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:29.363603 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-8e9a1a51-0239-42c5-b428-b9a69c80da58 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:29.370646 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8e9a1a51-0239-42c5-b428-b9a69c80da58 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:29.371129 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8e9a1a51-0239-42c5-b428-b9a69c80da58 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:29.371556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8e9a1a51-0239-42c5-b428-b9a69c80da58 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:29.372249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8e9a1a51-0239-42c5-b428-b9a69c80da58 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:29.372696 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8e9a1a51-0239-42c5-b428-b9a69c80da58 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:29.373145 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8e9a1a51-0239-42c5-b428-b9a69c80da58 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:29.451720 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-95d31a27-2885-4721-940e-c656d41b253a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:29.452452 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-95d31a27-2885-4721-940e-c656d41b253a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:29.459855 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-95d31a27-2885-4721-940e-c656d41b253a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:29.460422 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-95d31a27-2885-4721-940e-c656d41b253a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:29.460943 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-95d31a27-2885-4721-940e-c656d41b253a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:29.461649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-95d31a27-2885-4721-940e-c656d41b253a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:29.462100 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-95d31a27-2885-4721-940e-c656d41b253a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:29.462522 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-95d31a27-2885-4721-940e-c656d41b253a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:29.511556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8e9a1a51-0239-42c5-b428-b9a69c80da58 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:29.519849 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-8e9a1a51-0239-42c5-b428-b9a69c80da58 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.160636 Sep 06 16:21:29.532877 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 389/768] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:29 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:29.533584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-95d31a27-2885-4721-940e-c656d41b253a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:29.533584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-95d31a27-2885-4721-940e-c656d41b253a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1222 microversion: 2.1 time: 0.085525 Sep 06 16:21:29.534135 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 380/769] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:29 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:29.963612 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-44d363fc-6c28-40a9-86ca-6ce22531c915 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:29.964238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-44d363fc-6c28-40a9-86ca-6ce22531c915 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:29.970314 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44d363fc-6c28-40a9-86ca-6ce22531c915 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:29.970884 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44d363fc-6c28-40a9-86ca-6ce22531c915 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:29.971195 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44d363fc-6c28-40a9-86ca-6ce22531c915 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:29.971974 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44d363fc-6c28-40a9-86ca-6ce22531c915 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:29.972418 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44d363fc-6c28-40a9-86ca-6ce22531c915 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:29.972857 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44d363fc-6c28-40a9-86ca-6ce22531c915 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:30.110953 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-44d363fc-6c28-40a9-86ca-6ce22531c915 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:30.122304 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-44d363fc-6c28-40a9-86ca-6ce22531c915 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:30.124001 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-44d363fc-6c28-40a9-86ca-6ce22531c915 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:30.125217 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-44d363fc-6c28-40a9-86ca-6ce22531c915 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1795 microversion: 2.20 time: 0.165584 Sep 06 16:21:30.125761 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 390/770] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:21:29 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1795 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:21:30.546405 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-503b5419-261a-4f73-b54b-ce3b137fb1f9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:30.547618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-503b5419-261a-4f73-b54b-ce3b137fb1f9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:30.556819 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-503b5419-261a-4f73-b54b-ce3b137fb1f9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:30.557963 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-503b5419-261a-4f73-b54b-ce3b137fb1f9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:30.558107 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fc944813-46ff-466f-867d-e2cf2a4cdb0a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:30.559015 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fc944813-46ff-466f-867d-e2cf2a4cdb0a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:30.559173 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-503b5419-261a-4f73-b54b-ce3b137fb1f9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:30.560035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-503b5419-261a-4f73-b54b-ce3b137fb1f9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:30.560652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-503b5419-261a-4f73-b54b-ce3b137fb1f9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:30.561550 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-503b5419-261a-4f73-b54b-ce3b137fb1f9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:30.565675 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fc944813-46ff-466f-867d-e2cf2a4cdb0a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:30.566584 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fc944813-46ff-466f-867d-e2cf2a4cdb0a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:30.567133 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fc944813-46ff-466f-867d-e2cf2a4cdb0a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:30.567945 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fc944813-46ff-466f-867d-e2cf2a4cdb0a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:30.568472 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fc944813-46ff-466f-867d-e2cf2a4cdb0a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:30.569006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fc944813-46ff-466f-867d-e2cf2a4cdb0a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:30.687261 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fc944813-46ff-466f-867d-e2cf2a4cdb0a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:30.697226 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fc944813-46ff-466f-867d-e2cf2a4cdb0a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1278 microversion: 2.1 time: 0.145045 Sep 06 16:21:30.698388 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 391/771] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:30 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:30.883515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-503b5419-261a-4f73-b54b-ce3b137fb1f9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:30.891390 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-503b5419-261a-4f73-b54b-ce3b137fb1f9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.348912 Sep 06 16:21:30.891927 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 381/772] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:30 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:31.721379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2141d458-54f9-423a-a108-ed380ae42a1a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:31.721937 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2141d458-54f9-423a-a108-ed380ae42a1a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:31.728995 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2141d458-54f9-423a-a108-ed380ae42a1a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:31.729485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2141d458-54f9-423a-a108-ed380ae42a1a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:31.729921 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2141d458-54f9-423a-a108-ed380ae42a1a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:31.730774 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2141d458-54f9-423a-a108-ed380ae42a1a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:31.731230 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2141d458-54f9-423a-a108-ed380ae42a1a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:31.731879 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2141d458-54f9-423a-a108-ed380ae42a1a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:31.869874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2141d458-54f9-423a-a108-ed380ae42a1a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:31.880390 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2141d458-54f9-423a-a108-ed380ae42a1a tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1318 microversion: 2.1 time: 0.162953 Sep 06 16:21:31.892830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 392/773] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:31 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:31.914905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ff1cc891-8ee5-4273-b7aa-193210b326ad tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:31.915532 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ff1cc891-8ee5-4273-b7aa-193210b326ad tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:31.918152 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:31.923614 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ff1cc891-8ee5-4273-b7aa-193210b326ad tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:31.924251 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ff1cc891-8ee5-4273-b7aa-193210b326ad tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:31.924694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ff1cc891-8ee5-4273-b7aa-193210b326ad tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:31.925489 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ff1cc891-8ee5-4273-b7aa-193210b326ad tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:31.925942 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ff1cc891-8ee5-4273-b7aa-193210b326ad tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:31.926368 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ff1cc891-8ee5-4273-b7aa-193210b326ad tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:32.142590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ff1cc891-8ee5-4273-b7aa-193210b326ad tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:32.151001 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ff1cc891-8ee5-4273-b7aa-193210b326ad tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.240325 Sep 06 16:21:32.151878 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 382/774] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:31 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:32.377368 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-014ffdc7-53fc-44d9-be70-ed5e1c771001 req-eeacafcb-4a21-4e6b-b83a-8cf806f5643c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c1a582-5bed-4ef1-8fac-a5e91cb17d73", "tag": "f368bc3d-176b-4415-ac0a-e7fc574801f5"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:32.387642 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-014ffdc7-53fc-44d9-be70-ed5e1c771001 req-eeacafcb-4a21-4e6b-b83a-8cf806f5643c service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:32.388113 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-014ffdc7-53fc-44d9-be70-ed5e1c771001 req-eeacafcb-4a21-4e6b-b83a-8cf806f5643c service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:32.388540 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-014ffdc7-53fc-44d9-be70-ed5e1c771001 req-eeacafcb-4a21-4e6b-b83a-8cf806f5643c service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:32.399951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-014ffdc7-53fc-44d9-be70-ed5e1c771001 req-eeacafcb-4a21-4e6b-b83a-8cf806f5643c service nova] Creating event network-changed:f368bc3d-176b-4415-ac0a-e7fc574801f5 for instance 48c1a582-5bed-4ef1-8fac-a5e91cb17d73 on hv-cinder-85221 Sep 06 16:21:32.405025 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-014ffdc7-53fc-44d9-be70-ed5e1c771001 req-eeacafcb-4a21-4e6b-b83a-8cf806f5643c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164101 Sep 06 16:21:32.405691 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 393/775] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:21:32.816089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-a0edaf11-bcc0-46e8-ba08-96bfae105c41 req-4e32270e-9945-436a-984b-f2595f4109a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0703f63d-6ac9-4219-ac90-170280a05cf0", "name": "network-vif-plugged", "status": "completed", "tag": "73edccbd-1423-4fbf-a674-eaa6d1d6f849"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:32.826241 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-a0edaf11-bcc0-46e8-ba08-96bfae105c41 req-4e32270e-9945-436a-984b-f2595f4109a8 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:32.826699 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-a0edaf11-bcc0-46e8-ba08-96bfae105c41 req-4e32270e-9945-436a-984b-f2595f4109a8 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:32.827340 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-a0edaf11-bcc0-46e8-ba08-96bfae105c41 req-4e32270e-9945-436a-984b-f2595f4109a8 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:32.839035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-a0edaf11-bcc0-46e8-ba08-96bfae105c41 req-4e32270e-9945-436a-984b-f2595f4109a8 service nova] Creating event network-vif-plugged:73edccbd-1423-4fbf-a674-eaa6d1d6f849 for instance 0703f63d-6ac9-4219-ac90-170280a05cf0 on hv-cinder-85221 Sep 06 16:21:32.844279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-a0edaf11-bcc0-46e8-ba08-96bfae105c41 req-4e32270e-9945-436a-984b-f2595f4109a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031852 Sep 06 16:21:32.844910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 383/776] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:21:32.907715 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-dcdc5106-8bfe-489a-8e55-4fef14db176b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:32.908515 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-dcdc5106-8bfe-489a-8e55-4fef14db176b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:32.916602 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dcdc5106-8bfe-489a-8e55-4fef14db176b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:32.917141 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dcdc5106-8bfe-489a-8e55-4fef14db176b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:32.917572 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dcdc5106-8bfe-489a-8e55-4fef14db176b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:32.918399 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dcdc5106-8bfe-489a-8e55-4fef14db176b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:32.918853 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dcdc5106-8bfe-489a-8e55-4fef14db176b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:32.919278 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dcdc5106-8bfe-489a-8e55-4fef14db176b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:33.062533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dcdc5106-8bfe-489a-8e55-4fef14db176b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:33.070526 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-dcdc5106-8bfe-489a-8e55-4fef14db176b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1318 microversion: 2.1 time: 0.168598 Sep 06 16:21:33.071119 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 394/777] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:32 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:33.176010 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8e0ac7c4-072f-4340-9eea-e603dd90d3cf tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:33.176682 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8e0ac7c4-072f-4340-9eea-e603dd90d3cf tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:33.184205 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e0ac7c4-072f-4340-9eea-e603dd90d3cf tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:33.184684 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e0ac7c4-072f-4340-9eea-e603dd90d3cf tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:33.185377 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e0ac7c4-072f-4340-9eea-e603dd90d3cf tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:33.186079 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e0ac7c4-072f-4340-9eea-e603dd90d3cf tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:33.186531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e0ac7c4-072f-4340-9eea-e603dd90d3cf tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:33.186953 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e0ac7c4-072f-4340-9eea-e603dd90d3cf tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:33.325303 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8e0ac7c4-072f-4340-9eea-e603dd90d3cf tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:33.333412 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8e0ac7c4-072f-4340-9eea-e603dd90d3cf tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.162568 Sep 06 16:21:33.333994 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 384/778] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:33 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:34.095507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-434cb79b-84c0-4333-be69-5441c8399e3e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:34.096211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-434cb79b-84c0-4333-be69-5441c8399e3e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:34.104011 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-434cb79b-84c0-4333-be69-5441c8399e3e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:34.104508 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-434cb79b-84c0-4333-be69-5441c8399e3e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:34.104998 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-434cb79b-84c0-4333-be69-5441c8399e3e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:34.105705 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-434cb79b-84c0-4333-be69-5441c8399e3e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:34.106159 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-434cb79b-84c0-4333-be69-5441c8399e3e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:34.106579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-434cb79b-84c0-4333-be69-5441c8399e3e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:34.239095 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-434cb79b-84c0-4333-be69-5441c8399e3e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:34.247111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-434cb79b-84c0-4333-be69-5441c8399e3e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1318 microversion: 2.1 time: 0.156596 Sep 06 16:21:34.247878 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 395/779] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:34 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:34.358198 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5bd51b70-8540-48e7-89af-9a29ddf1e799 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:34.358775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5bd51b70-8540-48e7-89af-9a29ddf1e799 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:34.365959 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5bd51b70-8540-48e7-89af-9a29ddf1e799 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:34.366447 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5bd51b70-8540-48e7-89af-9a29ddf1e799 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:34.366880 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5bd51b70-8540-48e7-89af-9a29ddf1e799 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:34.367578 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5bd51b70-8540-48e7-89af-9a29ddf1e799 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:34.368033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5bd51b70-8540-48e7-89af-9a29ddf1e799 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:34.368456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5bd51b70-8540-48e7-89af-9a29ddf1e799 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:34.513655 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5bd51b70-8540-48e7-89af-9a29ddf1e799 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:34.521960 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5bd51b70-8540-48e7-89af-9a29ddf1e799 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.167797 Sep 06 16:21:34.522543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 385/780] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:34 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:35.270753 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ea0af2af-1601-4f38-84a2-0ba367aa62f8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:35.271583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ea0af2af-1601-4f38-84a2-0ba367aa62f8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:35.278805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea0af2af-1601-4f38-84a2-0ba367aa62f8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:35.279295 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea0af2af-1601-4f38-84a2-0ba367aa62f8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:35.279723 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea0af2af-1601-4f38-84a2-0ba367aa62f8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:35.280436 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea0af2af-1601-4f38-84a2-0ba367aa62f8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:35.280902 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea0af2af-1601-4f38-84a2-0ba367aa62f8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:35.281322 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ea0af2af-1601-4f38-84a2-0ba367aa62f8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:35.425210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ea0af2af-1601-4f38-84a2-0ba367aa62f8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:35.433694 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ea0af2af-1601-4f38-84a2-0ba367aa62f8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1318 microversion: 2.1 time: 0.167040 Sep 06 16:21:35.434245 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 396/781] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:35 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:35.544263 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f09f7770-ae64-490d-8409-7491bc652f88 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:35.544867 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f09f7770-ae64-490d-8409-7491bc652f88 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:35.555206 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f09f7770-ae64-490d-8409-7491bc652f88 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:35.555873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f09f7770-ae64-490d-8409-7491bc652f88 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:35.556457 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f09f7770-ae64-490d-8409-7491bc652f88 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:35.557800 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f09f7770-ae64-490d-8409-7491bc652f88 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:35.558397 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f09f7770-ae64-490d-8409-7491bc652f88 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:35.558977 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f09f7770-ae64-490d-8409-7491bc652f88 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:35.695663 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f09f7770-ae64-490d-8409-7491bc652f88 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:35.703784 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f09f7770-ae64-490d-8409-7491bc652f88 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.163496 Sep 06 16:21:35.704350 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 386/782] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:35 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:36.458817 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-19b90fc8-2810-4be8-894b-65dd894ac46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:36.459403 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-19b90fc8-2810-4be8-894b-65dd894ac46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:36.461430 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:36.467946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19b90fc8-2810-4be8-894b-65dd894ac46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:36.468539 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19b90fc8-2810-4be8-894b-65dd894ac46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:36.468999 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19b90fc8-2810-4be8-894b-65dd894ac46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:36.469730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19b90fc8-2810-4be8-894b-65dd894ac46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:36.470174 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19b90fc8-2810-4be8-894b-65dd894ac46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:36.470586 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19b90fc8-2810-4be8-894b-65dd894ac46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:36.624412 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-19b90fc8-2810-4be8-894b-65dd894ac46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:36.632885 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-19b90fc8-2810-4be8-894b-65dd894ac46b tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1318 microversion: 2.1 time: 0.178125 Sep 06 16:21:36.640902 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 397/783] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:36 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:36.726818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-110c79d0-32e2-48dd-a3dd-617fb87382e5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:36.727437 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-110c79d0-32e2-48dd-a3dd-617fb87382e5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:36.729517 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:36.730203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=6 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:36.736604 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-110c79d0-32e2-48dd-a3dd-617fb87382e5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:36.737120 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-110c79d0-32e2-48dd-a3dd-617fb87382e5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:36.737554 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-110c79d0-32e2-48dd-a3dd-617fb87382e5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:36.738388 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-110c79d0-32e2-48dd-a3dd-617fb87382e5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:36.738839 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-110c79d0-32e2-48dd-a3dd-617fb87382e5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:36.739263 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-110c79d0-32e2-48dd-a3dd-617fb87382e5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:36.881770 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-110c79d0-32e2-48dd-a3dd-617fb87382e5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:36.893960 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-110c79d0-32e2-48dd-a3dd-617fb87382e5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.170659 Sep 06 16:21:36.894697 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 387/784] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:36 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:37.656532 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-774b74c1-d377-495c-88c7-9827fe63f49d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:37.658021 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-774b74c1-d377-495c-88c7-9827fe63f49d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:37.664547 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-774b74c1-d377-495c-88c7-9827fe63f49d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:37.665068 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-774b74c1-d377-495c-88c7-9827fe63f49d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:37.665470 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-774b74c1-d377-495c-88c7-9827fe63f49d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:37.666156 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-774b74c1-d377-495c-88c7-9827fe63f49d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:37.666593 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-774b74c1-d377-495c-88c7-9827fe63f49d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:37.667205 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-774b74c1-d377-495c-88c7-9827fe63f49d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:37.811027 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-774b74c1-d377-495c-88c7-9827fe63f49d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:37.821147 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-774b74c1-d377-495c-88c7-9827fe63f49d tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1318 microversion: 2.1 time: 0.168382 Sep 06 16:21:37.821959 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 398/785] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:37 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:37.917299 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6ad43a07-47e5-49d8-a84d-3653ef344d3a tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:37.917882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6ad43a07-47e5-49d8-a84d-3653ef344d3a tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:37.924738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ad43a07-47e5-49d8-a84d-3653ef344d3a tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:37.925256 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ad43a07-47e5-49d8-a84d-3653ef344d3a tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:37.925686 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ad43a07-47e5-49d8-a84d-3653ef344d3a tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:37.926377 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ad43a07-47e5-49d8-a84d-3653ef344d3a tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:37.926823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ad43a07-47e5-49d8-a84d-3653ef344d3a tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:37.927270 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ad43a07-47e5-49d8-a84d-3653ef344d3a tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:38.065355 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6ad43a07-47e5-49d8-a84d-3653ef344d3a tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:38.075227 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6ad43a07-47e5-49d8-a84d-3653ef344d3a tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1314 microversion: 2.1 time: 0.161830 Sep 06 16:21:38.075981 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 388/786] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:37 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:38.845263 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fd43e9be-a4e1-4ffb-ad92-883715aec0fa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:38.845880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fd43e9be-a4e1-4ffb-ad92-883715aec0fa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:38.852836 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fd43e9be-a4e1-4ffb-ad92-883715aec0fa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:38.853335 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fd43e9be-a4e1-4ffb-ad92-883715aec0fa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:38.853758 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fd43e9be-a4e1-4ffb-ad92-883715aec0fa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:38.854435 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fd43e9be-a4e1-4ffb-ad92-883715aec0fa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:38.854874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fd43e9be-a4e1-4ffb-ad92-883715aec0fa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:38.855284 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fd43e9be-a4e1-4ffb-ad92-883715aec0fa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:38.988857 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fd43e9be-a4e1-4ffb-ad92-883715aec0fa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:38.996822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fd43e9be-a4e1-4ffb-ad92-883715aec0fa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1318 microversion: 2.1 time: 0.155538 Sep 06 16:21:38.997388 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 399/787] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:38 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:39.098514 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fe003d2a-40be-4152-a4f5-3ce64b2ba560 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:39.098986 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fe003d2a-40be-4152-a4f5-3ce64b2ba560 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:39.106054 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fe003d2a-40be-4152-a4f5-3ce64b2ba560 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:39.106530 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fe003d2a-40be-4152-a4f5-3ce64b2ba560 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:39.106953 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fe003d2a-40be-4152-a4f5-3ce64b2ba560 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:39.107646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fe003d2a-40be-4152-a4f5-3ce64b2ba560 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:39.108091 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fe003d2a-40be-4152-a4f5-3ce64b2ba560 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:39.108507 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fe003d2a-40be-4152-a4f5-3ce64b2ba560 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:39.209033 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-23864b84-745b-4afb-acd1-77ed4caea4a3 req-abf971a0-5cc0-46b7-8f3d-44795ad7a53a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c1a582-5bed-4ef1-8fac-a5e91cb17d73", "name": "network-vif-plugged", "status": "completed", "tag": "f368bc3d-176b-4415-ac0a-e7fc574801f5"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:39.219089 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-23864b84-745b-4afb-acd1-77ed4caea4a3 req-abf971a0-5cc0-46b7-8f3d-44795ad7a53a service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:39.219672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-23864b84-745b-4afb-acd1-77ed4caea4a3 req-abf971a0-5cc0-46b7-8f3d-44795ad7a53a service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:39.220088 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-23864b84-745b-4afb-acd1-77ed4caea4a3 req-abf971a0-5cc0-46b7-8f3d-44795ad7a53a service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:39.231847 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-23864b84-745b-4afb-acd1-77ed4caea4a3 req-abf971a0-5cc0-46b7-8f3d-44795ad7a53a service nova] Creating event network-vif-plugged:f368bc3d-176b-4415-ac0a-e7fc574801f5 for instance 48c1a582-5bed-4ef1-8fac-a5e91cb17d73 on hv-cinder-85221 Sep 06 16:21:39.237384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-23864b84-745b-4afb-acd1-77ed4caea4a3 req-abf971a0-5cc0-46b7-8f3d-44795ad7a53a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032001 Sep 06 16:21:39.238023 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 400/788] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:21:39.245651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fe003d2a-40be-4152-a4f5-3ce64b2ba560 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:39.255391 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fe003d2a-40be-4152-a4f5-3ce64b2ba560 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1464 microversion: 2.1 time: 0.160792 Sep 06 16:21:39.255951 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 389/789] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:39 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:39.315159 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9d4ea6c0-2a79-44de-b550-715919572bc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:39.315768 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9d4ea6c0-2a79-44de-b550-715919572bc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:39.322313 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9d4ea6c0-2a79-44de-b550-715919572bc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:39.322791 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9d4ea6c0-2a79-44de-b550-715919572bc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:39.323238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9d4ea6c0-2a79-44de-b550-715919572bc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:39.323916 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9d4ea6c0-2a79-44de-b550-715919572bc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:39.324360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9d4ea6c0-2a79-44de-b550-715919572bc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:39.324801 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9d4ea6c0-2a79-44de-b550-715919572bc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:39.350953 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9d4ea6c0-2a79-44de-b550-715919572bc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Going to try to terminate instance {{(pid=120668) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:21:39.388020 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:39.438185 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9d4ea6c0-2a79-44de-b550-715919572bc5 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 204 len: 0 microversion: 2.1 time: 0.126922 Sep 06 16:21:39.438943 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 401/790] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:21:39 2022] DELETE /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:21:39.447694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cfc06174-9c86-4d66-a4bc-51cad643702d tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:39.448310 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cfc06174-9c86-4d66-a4bc-51cad643702d tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:39.456866 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cfc06174-9c86-4d66-a4bc-51cad643702d tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:39.457358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cfc06174-9c86-4d66-a4bc-51cad643702d tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:39.457809 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cfc06174-9c86-4d66-a4bc-51cad643702d tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:39.458556 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cfc06174-9c86-4d66-a4bc-51cad643702d tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:39.459270 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cfc06174-9c86-4d66-a4bc-51cad643702d tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:39.459761 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cfc06174-9c86-4d66-a4bc-51cad643702d tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:39.614720 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cfc06174-9c86-4d66-a4bc-51cad643702d tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:39.622920 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cfc06174-9c86-4d66-a4bc-51cad643702d tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1470 microversion: 2.1 time: 0.179401 Sep 06 16:21:39.623733 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 390/791] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:39 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:40.020443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-21670af5-5822-42a9-a9ae-0ee43ee372c4 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:40.021172 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-21670af5-5822-42a9-a9ae-0ee43ee372c4 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:40.027940 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-21670af5-5822-42a9-a9ae-0ee43ee372c4 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:40.028418 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-21670af5-5822-42a9-a9ae-0ee43ee372c4 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:40.028851 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-21670af5-5822-42a9-a9ae-0ee43ee372c4 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:40.029534 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-21670af5-5822-42a9-a9ae-0ee43ee372c4 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:40.029994 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-21670af5-5822-42a9-a9ae-0ee43ee372c4 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:40.030472 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-21670af5-5822-42a9-a9ae-0ee43ee372c4 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:40.169222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-21670af5-5822-42a9-a9ae-0ee43ee372c4 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:40.177035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-21670af5-5822-42a9-a9ae-0ee43ee372c4 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1318 microversion: 2.1 time: 0.160844 Sep 06 16:21:40.177607 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 402/792] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:40 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:40.648490 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a9e31126-a179-48d9-8ad1-34e03d321cec tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:40.649436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a9e31126-a179-48d9-8ad1-34e03d321cec tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:40.657630 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a9e31126-a179-48d9-8ad1-34e03d321cec tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:40.658131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a9e31126-a179-48d9-8ad1-34e03d321cec tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:40.658562 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a9e31126-a179-48d9-8ad1-34e03d321cec tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:40.661372 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a9e31126-a179-48d9-8ad1-34e03d321cec tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:40.661871 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a9e31126-a179-48d9-8ad1-34e03d321cec tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:40.662309 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a9e31126-a179-48d9-8ad1-34e03d321cec tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:40.683930 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:40.799988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a9e31126-a179-48d9-8ad1-34e03d321cec tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:40.809088 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a9e31126-a179-48d9-8ad1-34e03d321cec tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1470 microversion: 2.1 time: 0.165640 Sep 06 16:21:40.809662 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 391/793] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:40 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:41.199861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-db208993-91c8-44b7-b696-9e6d89776f11 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:41.200473 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-db208993-91c8-44b7-b696-9e6d89776f11 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:41.203022 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:41.209419 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db208993-91c8-44b7-b696-9e6d89776f11 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:41.209956 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db208993-91c8-44b7-b696-9e6d89776f11 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:41.210404 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db208993-91c8-44b7-b696-9e6d89776f11 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:41.211078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db208993-91c8-44b7-b696-9e6d89776f11 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:41.211613 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db208993-91c8-44b7-b696-9e6d89776f11 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:41.212039 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db208993-91c8-44b7-b696-9e6d89776f11 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:41.358355 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-db208993-91c8-44b7-b696-9e6d89776f11 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:41.366681 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-db208993-91c8-44b7-b696-9e6d89776f11 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1318 microversion: 2.1 time: 0.170684 Sep 06 16:21:41.367272 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 403/794] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:41 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:41.835048 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f4ab4c94-8bff-4a05-bb19-1faf6af3aff1 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:41.835686 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f4ab4c94-8bff-4a05-bb19-1faf6af3aff1 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:41.842925 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f4ab4c94-8bff-4a05-bb19-1faf6af3aff1 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:41.843414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f4ab4c94-8bff-4a05-bb19-1faf6af3aff1 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:41.843850 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f4ab4c94-8bff-4a05-bb19-1faf6af3aff1 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:41.844547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f4ab4c94-8bff-4a05-bb19-1faf6af3aff1 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:41.845039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f4ab4c94-8bff-4a05-bb19-1faf6af3aff1 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:41.845462 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f4ab4c94-8bff-4a05-bb19-1faf6af3aff1 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:41.980250 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f4ab4c94-8bff-4a05-bb19-1faf6af3aff1 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:41.988350 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f4ab4c94-8bff-4a05-bb19-1faf6af3aff1 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1470 microversion: 2.1 time: 0.157328 Sep 06 16:21:41.988993 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 392/795] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:41 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:42.393227 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5a91b20e-0490-4bb7-9ec2-1a7b5868c4ac tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:42.393810 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5a91b20e-0490-4bb7-9ec2-1a7b5868c4ac tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:42.401239 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5a91b20e-0490-4bb7-9ec2-1a7b5868c4ac tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:42.401724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5a91b20e-0490-4bb7-9ec2-1a7b5868c4ac tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:42.402149 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5a91b20e-0490-4bb7-9ec2-1a7b5868c4ac tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:42.402831 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5a91b20e-0490-4bb7-9ec2-1a7b5868c4ac tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:42.403274 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5a91b20e-0490-4bb7-9ec2-1a7b5868c4ac tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:42.403684 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5a91b20e-0490-4bb7-9ec2-1a7b5868c4ac tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:42.538866 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5a91b20e-0490-4bb7-9ec2-1a7b5868c4ac tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:42.546961 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5a91b20e-0490-4bb7-9ec2-1a7b5868c4ac tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1318 microversion: 2.1 time: 0.159593 Sep 06 16:21:42.547535 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 404/796] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:42 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:43.011812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-31156b9a-c959-4088-bfcc-9274ad4f7cf9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:43.012416 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-31156b9a-c959-4088-bfcc-9274ad4f7cf9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:43.019615 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31156b9a-c959-4088-bfcc-9274ad4f7cf9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:43.020123 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31156b9a-c959-4088-bfcc-9274ad4f7cf9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:43.020870 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31156b9a-c959-4088-bfcc-9274ad4f7cf9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:43.021574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31156b9a-c959-4088-bfcc-9274ad4f7cf9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:43.022022 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31156b9a-c959-4088-bfcc-9274ad4f7cf9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:43.022450 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-31156b9a-c959-4088-bfcc-9274ad4f7cf9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:43.255965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-31156b9a-c959-4088-bfcc-9274ad4f7cf9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:43.264179 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-31156b9a-c959-4088-bfcc-9274ad4f7cf9 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1470 microversion: 2.1 time: 0.256268 Sep 06 16:21:43.264797 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 393/797] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:43 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1470 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:43.553412 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-ab69b33e-e0d1-4a2e-b3e2-6ae56d214c37 req-eb53ef89-733d-48c1-b0d2-4355701e2397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0703f63d-6ac9-4219-ac90-170280a05cf0", "name": "network-vif-deleted", "tag": "73edccbd-1423-4fbf-a674-eaa6d1d6f849"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:43.566412 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-ab69b33e-e0d1-4a2e-b3e2-6ae56d214c37 req-eb53ef89-733d-48c1-b0d2-4355701e2397 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:43.566993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-ab69b33e-e0d1-4a2e-b3e2-6ae56d214c37 req-eb53ef89-733d-48c1-b0d2-4355701e2397 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:43.567523 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-ab69b33e-e0d1-4a2e-b3e2-6ae56d214c37 req-eb53ef89-733d-48c1-b0d2-4355701e2397 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:43.570549 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-993d759e-75a5-45cd-b084-aab1d8e5827f tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:43.571156 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-993d759e-75a5-45cd-b084-aab1d8e5827f tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:43.579347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-993d759e-75a5-45cd-b084-aab1d8e5827f tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:43.579834 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-993d759e-75a5-45cd-b084-aab1d8e5827f tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:43.580267 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-993d759e-75a5-45cd-b084-aab1d8e5827f tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:43.581073 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-993d759e-75a5-45cd-b084-aab1d8e5827f tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:43.581565 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-993d759e-75a5-45cd-b084-aab1d8e5827f tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:43.582027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-993d759e-75a5-45cd-b084-aab1d8e5827f tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:43.584046 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-ab69b33e-e0d1-4a2e-b3e2-6ae56d214c37 req-eb53ef89-733d-48c1-b0d2-4355701e2397 service nova] Creating event network-vif-deleted:73edccbd-1423-4fbf-a674-eaa6d1d6f849 for instance 0703f63d-6ac9-4219-ac90-170280a05cf0 on hv-cinder-85221 Sep 06 16:21:43.593471 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-ab69b33e-e0d1-4a2e-b3e2-6ae56d214c37 req-eb53ef89-733d-48c1-b0d2-4355701e2397 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043336 Sep 06 16:21:43.594876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 405/798] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:21:43.730126 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-993d759e-75a5-45cd-b084-aab1d8e5827f tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:43.738255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-993d759e-75a5-45cd-b084-aab1d8e5827f tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1318 microversion: 2.1 time: 0.172246 Sep 06 16:21:43.738834 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 394/799] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:43 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:44.288073 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:44.288835 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:44.295633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:44.295870 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:44.296295 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:44.297024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:44.297468 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:44.297885 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:44.330273 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:44.330752 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:44.331181 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:44.331819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lazy-loading 'fault' on Instance uuid 0703f63d-6ac9-4219-ac90-170280a05cf0 {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:21:44.377908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42904081b7f74a3887e8ecb8e59b10c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c5034fbe9f4d2e9ee9c372dee6f2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:44.385911 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d61a0a47-127e-4f08-b549-dbf02eb7d090 tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 200 len: 1304 microversion: 2.1 time: 0.102110 Sep 06 16:21:44.386495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 406/800] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:44 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:44.764744 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b33a3411-017d-4c41-9cca-78fdbc72da44 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:44.765732 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b33a3411-017d-4c41-9cca-78fdbc72da44 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:44.775248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b33a3411-017d-4c41-9cca-78fdbc72da44 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:44.775744 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b33a3411-017d-4c41-9cca-78fdbc72da44 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:44.776165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b33a3411-017d-4c41-9cca-78fdbc72da44 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:44.776903 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b33a3411-017d-4c41-9cca-78fdbc72da44 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:44.777353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b33a3411-017d-4c41-9cca-78fdbc72da44 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:44.777780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b33a3411-017d-4c41-9cca-78fdbc72da44 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:44.916389 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b33a3411-017d-4c41-9cca-78fdbc72da44 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:44.924280 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b33a3411-017d-4c41-9cca-78fdbc72da44 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1508 microversion: 2.1 time: 0.165837 Sep 06 16:21:44.924902 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 395/801] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:44 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:44.951393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d3809af3-a133-43a1-9b15-ed0c4082e40e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "175fc7ec-f72b-4937-b603-fec470101db8", "device": "/dev/sdb"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:44.954069 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d3809af3-a133-43a1-9b15-ed0c4082e40e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:44.961730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d3809af3-a133-43a1-9b15-ed0c4082e40e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:44.962250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d3809af3-a133-43a1-9b15-ed0c4082e40e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:44.962749 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d3809af3-a133-43a1-9b15-ed0c4082e40e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:44.963479 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d3809af3-a133-43a1-9b15-ed0c4082e40e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:44.963970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d3809af3-a133-43a1-9b15-ed0c4082e40e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:44.964458 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d3809af3-a133-43a1-9b15-ed0c4082e40e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:45.245947 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d3809af3-a133-43a1-9b15-ed0c4082e40e tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "POST /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298937 Sep 06 16:21:45.246572 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 407/802] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:21:44 2022] POST /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:21:45.411670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f3f54933-9b25-432e-857d-c7b5d5d547fe tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:45.412272 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f3f54933-9b25-432e-857d-c7b5d5d547fe tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] [instance: 0703f63d-6ac9-4219-ac90-170280a05cf0] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:45.418639 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f3f54933-9b25-432e-857d-c7b5d5d547fe tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:45.419129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f3f54933-9b25-432e-857d-c7b5d5d547fe tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:45.419560 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f3f54933-9b25-432e-857d-c7b5d5d547fe tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:45.420237 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f3f54933-9b25-432e-857d-c7b5d5d547fe tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:45.420818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f3f54933-9b25-432e-857d-c7b5d5d547fe tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:45.421469 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f3f54933-9b25-432e-857d-c7b5d5d547fe tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:45.436267 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-f3f54933-9b25-432e-857d-c7b5d5d547fe tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] HTTP exception thrown: Instance 0703f63d-6ac9-4219-ac90-170280a05cf0 could not be found. Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f3f54933-9b25-432e-857d-c7b5d5d547fe tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Request method failure captured: Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 HTTP/1.1 Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3N3xu7CfM0fz_JCQL1WBJX9rctbv69CO6RzQPNffDr7da4RuuXT34gEknhm8LSuy_oHsPZFC23fHMfSOwXNJAXR4Nc5SQfWvom1IwgGRUsY9I3cSVY-2bxgm5J1BqgDm_APeN6WLh11d5DIHDD5WII6lkeehTzTNY-fZTgKiPo_8Z0 Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 34c5034fbe9f4d2e9ee9c372dee6f2e6 Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesNegativeTest-5932960 Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:21:45.438033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:21:45.439606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34c5034fbe9f4d2e9ee9c372dee6f2e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34c5034fbe9f4d2e9ee9c372dee6f2e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_34c5034fbe9f4d2e9ee9c372dee6f2e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/34c5034fbe9f4d2e9ee9c372dee6f2e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:21:45.439606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesNegativeTest-5932960 Sep 06 16:21:45.439606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 34c5034fbe9f4d2e9ee9c372dee6f2e6 Sep 06 16:21:45.439606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesNegativeTest-5932960 Sep 06 16:21:45.439606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesNegativeTest-5932960-project Sep 06 16:21:45.439606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:21:45.439606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:21:45.439606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 42904081b7f74a3887e8ecb8e59b10c2 Sep 06 16:21:45.439606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesNegativeTest-5932960-project Sep 06 16:21:45.439606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:21:45.439606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance 0703f63d-6ac9-4219-ac90-170280a05cf0 could not be found. Sep 06 16:21:45.439606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': '0703f63d-6ac9-4219-ac90-170280a05cf0'} Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0703f63d-6ac9-4219-ac90-170280a05cf0 could not be found. Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:21:45.440463 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0703f63d-6ac9-4219-ac90-170280a05cf0 could not be found. Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0703f63d-6ac9-4219-ac90-170280a05cf0 could not be found. Sep 06 16:21:45.442084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:21:45.443751 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f3f54933-9b25-432e-857d-c7b5d5d547fe tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] Returning 404 to user: Instance 0703f63d-6ac9-4219-ac90-170280a05cf0 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:21:45.443751 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f3f54933-9b25-432e-857d-c7b5d5d547fe tempest-VolumesNegativeTest-5932960 tempest-VolumesNegativeTest-5932960-project] 10.222.0.43 "GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0" status: 404 len: 111 microversion: 2.1 time: 0.031750 Sep 06 16:21:45.443751 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 396/803] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:45 2022] GET /compute/v2.1/servers/0703f63d-6ac9-4219-ac90-170280a05cf0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:21:54.706051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1f772230-e10b-4cef-8b9f-c4c6746b891f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:54.714189 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1f772230-e10b-4cef-8b9f-c4c6746b891f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:54.724707 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f772230-e10b-4cef-8b9f-c4c6746b891f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:54.725315 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f772230-e10b-4cef-8b9f-c4c6746b891f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:54.725736 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f772230-e10b-4cef-8b9f-c4c6746b891f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:54.726449 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f772230-e10b-4cef-8b9f-c4c6746b891f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:54.726919 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f772230-e10b-4cef-8b9f-c4c6746b891f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:54.727339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f772230-e10b-4cef-8b9f-c4c6746b891f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:54.847157 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1f772230-e10b-4cef-8b9f-c4c6746b891f tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "POST /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/action" status: 202 len: 0 microversion: 2.1 time: 0.142208 Sep 06 16:21:54.847996 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 408/804] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:21:54 2022] POST /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:21:54.857102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c86b5be4-3219-47c4-a155-08980c86ecb1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:54.859237 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c86b5be4-3219-47c4-a155-08980c86ecb1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:54.867188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c86b5be4-3219-47c4-a155-08980c86ecb1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:54.867746 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c86b5be4-3219-47c4-a155-08980c86ecb1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:54.868330 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c86b5be4-3219-47c4-a155-08980c86ecb1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:54.869349 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c86b5be4-3219-47c4-a155-08980c86ecb1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:54.870094 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c86b5be4-3219-47c4-a155-08980c86ecb1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:54.870569 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c86b5be4-3219-47c4-a155-08980c86ecb1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:55.050215 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c86b5be4-3219-47c4-a155-08980c86ecb1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:55.065772 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c86b5be4-3219-47c4-a155-08980c86ecb1 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1750 microversion: 2.1 time: 0.207323 Sep 06 16:21:55.065772 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 397/805] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:54 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1750 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:56.086774 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fb6ffd07-fc12-48f3-9dac-ad965fc6e8fd tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:56.087420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fb6ffd07-fc12-48f3-9dac-ad965fc6e8fd tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:56.094702 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb6ffd07-fc12-48f3-9dac-ad965fc6e8fd tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:56.095238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb6ffd07-fc12-48f3-9dac-ad965fc6e8fd tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:56.095691 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb6ffd07-fc12-48f3-9dac-ad965fc6e8fd tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:56.096379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb6ffd07-fc12-48f3-9dac-ad965fc6e8fd tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:56.097091 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb6ffd07-fc12-48f3-9dac-ad965fc6e8fd tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:56.097590 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb6ffd07-fc12-48f3-9dac-ad965fc6e8fd tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:56.309720 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fb6ffd07-fc12-48f3-9dac-ad965fc6e8fd tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:56.324457 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fb6ffd07-fc12-48f3-9dac-ad965fc6e8fd tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1750 microversion: 2.1 time: 0.242651 Sep 06 16:21:56.327157 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 409/806] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:56 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1750 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:57.348124 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5ba9556d-ee18-4ffb-9c3f-a441fd72d7c2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:57.348794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5ba9556d-ee18-4ffb-9c3f-a441fd72d7c2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:57.355316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5ba9556d-ee18-4ffb-9c3f-a441fd72d7c2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:57.357953 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5ba9556d-ee18-4ffb-9c3f-a441fd72d7c2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:57.357953 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5ba9556d-ee18-4ffb-9c3f-a441fd72d7c2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:57.357953 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5ba9556d-ee18-4ffb-9c3f-a441fd72d7c2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:57.357953 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5ba9556d-ee18-4ffb-9c3f-a441fd72d7c2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:57.361510 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5ba9556d-ee18-4ffb-9c3f-a441fd72d7c2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:57.547550 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5ba9556d-ee18-4ffb-9c3f-a441fd72d7c2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:57.563072 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5ba9556d-ee18-4ffb-9c3f-a441fd72d7c2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1750 microversion: 2.1 time: 0.218726 Sep 06 16:21:57.563996 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 398/807] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:57 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1750 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:58.599483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7c5cba5d-6d18-45c6-ae5e-158ce68ca4ef tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:58.600937 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7c5cba5d-6d18-45c6-ae5e-158ce68ca4ef tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:58.608031 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7c5cba5d-6d18-45c6-ae5e-158ce68ca4ef tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:58.608912 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7c5cba5d-6d18-45c6-ae5e-158ce68ca4ef tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:58.609561 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7c5cba5d-6d18-45c6-ae5e-158ce68ca4ef tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:58.610549 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7c5cba5d-6d18-45c6-ae5e-158ce68ca4ef tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:58.611223 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7c5cba5d-6d18-45c6-ae5e-158ce68ca4ef tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:58.611853 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7c5cba5d-6d18-45c6-ae5e-158ce68ca4ef tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:58.798934 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7c5cba5d-6d18-45c6-ae5e-158ce68ca4ef tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:58.812318 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7c5cba5d-6d18-45c6-ae5e-158ce68ca4ef tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1750 microversion: 2.1 time: 0.217655 Sep 06 16:21:58.829942 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 410/808] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:58 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1750 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:59.844270 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4f57f22e-7053-4040-89a7-8af021c74532 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:59.845454 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4f57f22e-7053-4040-89a7-8af021c74532 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:59.857630 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f57f22e-7053-4040-89a7-8af021c74532 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:59.858254 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f57f22e-7053-4040-89a7-8af021c74532 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:59.858747 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f57f22e-7053-4040-89a7-8af021c74532 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:59.859706 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f57f22e-7053-4040-89a7-8af021c74532 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:59.860358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f57f22e-7053-4040-89a7-8af021c74532 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:59.860995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f57f22e-7053-4040-89a7-8af021c74532 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:00.180536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4f57f22e-7053-4040-89a7-8af021c74532 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:00.191038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4f57f22e-7053-4040-89a7-8af021c74532 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1750 microversion: 2.1 time: 0.355323 Sep 06 16:22:00.192538 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 399/809] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:59 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1750 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:01.218677 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-34b5aa69-6597-4dcf-b352-8008081d4f44 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:01.219926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-34b5aa69-6597-4dcf-b352-8008081d4f44 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:01.226977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34b5aa69-6597-4dcf-b352-8008081d4f44 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:01.227462 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34b5aa69-6597-4dcf-b352-8008081d4f44 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:01.227883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34b5aa69-6597-4dcf-b352-8008081d4f44 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:01.228574 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34b5aa69-6597-4dcf-b352-8008081d4f44 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:01.229042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34b5aa69-6597-4dcf-b352-8008081d4f44 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:01.229458 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-34b5aa69-6597-4dcf-b352-8008081d4f44 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:01.407169 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-34b5aa69-6597-4dcf-b352-8008081d4f44 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:01.418898 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-34b5aa69-6597-4dcf-b352-8008081d4f44 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.204310 Sep 06 16:22:01.419482 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 411/810] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:01 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:01.495283 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-84b6bb35-0601-4d64-acee-30abd631863f tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Action: 'create', calling method: .version_select at 0x7f83ecd52a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-923325397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp/us5pTXU1bF+w0/CRy5wIkHlajHJxITar4qcXFwSDH96GfNZBK8rZjUXFESntR8vo7I2M2GzeijVfhc60IaMVABY6B7FwTtuLuJeJkMF7B42pXoxIgqbKElwmXdV/Lw=="}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:01.514314 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-84b6bb35-0601-4d64-acee-30abd631863f tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Getting quotas for project f90ec559752b44b2b67c765488814865. Resources: {'key_pairs'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:22:01.518626 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-84b6bb35-0601-4d64-acee-30abd631863f tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Getting quotas for user 4d3856b7bb7f4f5bb801952b893bbe35 and project f90ec559752b44b2b67c765488814865. Resources: {'key_pairs'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:22:01.545415 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-84b6bb35-0601-4d64-acee-30abd631863f tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.248745 Sep 06 16:22:01.545936 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 400/811] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 6 16:22:01 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:02.446919 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-17d1244e-49e6-4362-bfe8-1bea1c8ace42 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:02.447838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-17d1244e-49e6-4362-bfe8-1bea1c8ace42 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:02.455291 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-17d1244e-49e6-4362-bfe8-1bea1c8ace42 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:02.455925 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-17d1244e-49e6-4362-bfe8-1bea1c8ace42 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:02.456824 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-17d1244e-49e6-4362-bfe8-1bea1c8ace42 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:02.458071 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-17d1244e-49e6-4362-bfe8-1bea1c8ace42 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:02.458533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-17d1244e-49e6-4362-bfe8-1bea1c8ace42 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:02.459124 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-17d1244e-49e6-4362-bfe8-1bea1c8ace42 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:02.679471 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-17d1244e-49e6-4362-bfe8-1bea1c8ace42 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:02.688464 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-17d1244e-49e6-4362-bfe8-1bea1c8ace42 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.246393 Sep 06 16:22:02.689062 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 412/812] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:02 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:03.712839 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3d2c05ad-1f32-4773-8b22-62a916a3fddc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:03.713425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-3d2c05ad-1f32-4773-8b22-62a916a3fddc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:03.715218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:03.721960 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3d2c05ad-1f32-4773-8b22-62a916a3fddc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:03.722422 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3d2c05ad-1f32-4773-8b22-62a916a3fddc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:03.722869 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3d2c05ad-1f32-4773-8b22-62a916a3fddc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:03.723573 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3d2c05ad-1f32-4773-8b22-62a916a3fddc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:03.724036 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3d2c05ad-1f32-4773-8b22-62a916a3fddc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:03.724454 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3d2c05ad-1f32-4773-8b22-62a916a3fddc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:03.891383 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3d2c05ad-1f32-4773-8b22-62a916a3fddc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:03.900050 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-3d2c05ad-1f32-4773-8b22-62a916a3fddc tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.191730 Sep 06 16:22:03.900612 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 401/813] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:03 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:04.923801 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c72559dc-8848-455c-b138-edfdbccade08 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:04.924468 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c72559dc-8848-455c-b138-edfdbccade08 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:04.932206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c72559dc-8848-455c-b138-edfdbccade08 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:04.932707 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c72559dc-8848-455c-b138-edfdbccade08 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:04.933185 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c72559dc-8848-455c-b138-edfdbccade08 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:04.933875 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c72559dc-8848-455c-b138-edfdbccade08 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:04.934343 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c72559dc-8848-455c-b138-edfdbccade08 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:04.934787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c72559dc-8848-455c-b138-edfdbccade08 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:05.109253 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c72559dc-8848-455c-b138-edfdbccade08 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:05.119012 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c72559dc-8848-455c-b138-edfdbccade08 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.199170 Sep 06 16:22:05.119598 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 413/814] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:04 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:06.148351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f977bc62-3a8a-451c-be41-2247a78b582e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:06.149788 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f977bc62-3a8a-451c-be41-2247a78b582e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:06.169989 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f977bc62-3a8a-451c-be41-2247a78b582e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:06.170203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f977bc62-3a8a-451c-be41-2247a78b582e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:06.170789 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f977bc62-3a8a-451c-be41-2247a78b582e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:06.171715 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f977bc62-3a8a-451c-be41-2247a78b582e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:06.172356 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f977bc62-3a8a-451c-be41-2247a78b582e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:06.173675 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f977bc62-3a8a-451c-be41-2247a78b582e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:06.357500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f977bc62-3a8a-451c-be41-2247a78b582e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:06.379884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f977bc62-3a8a-451c-be41-2247a78b582e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.240903 Sep 06 16:22:06.380526 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 402/815] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:06 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:07.403849 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-89457b61-b99b-46ee-b7c9-635f929fadd5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:07.404467 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-89457b61-b99b-46ee-b7c9-635f929fadd5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:07.411549 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89457b61-b99b-46ee-b7c9-635f929fadd5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:07.412034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89457b61-b99b-46ee-b7c9-635f929fadd5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:07.412494 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89457b61-b99b-46ee-b7c9-635f929fadd5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:07.413225 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89457b61-b99b-46ee-b7c9-635f929fadd5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:07.413672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89457b61-b99b-46ee-b7c9-635f929fadd5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:07.414124 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89457b61-b99b-46ee-b7c9-635f929fadd5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:07.583781 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-89457b61-b99b-46ee-b7c9-635f929fadd5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:07.593111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-89457b61-b99b-46ee-b7c9-635f929fadd5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.193021 Sep 06 16:22:07.593848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 414/816] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:07 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:08.621089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5068b371-38eb-485e-bad9-66f0425d105d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:08.621658 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5068b371-38eb-485e-bad9-66f0425d105d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:08.628696 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5068b371-38eb-485e-bad9-66f0425d105d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:08.629244 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5068b371-38eb-485e-bad9-66f0425d105d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:08.629693 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5068b371-38eb-485e-bad9-66f0425d105d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:08.630405 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5068b371-38eb-485e-bad9-66f0425d105d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:08.630848 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5068b371-38eb-485e-bad9-66f0425d105d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:08.631262 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5068b371-38eb-485e-bad9-66f0425d105d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:08.790955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5068b371-38eb-485e-bad9-66f0425d105d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:08.799457 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5068b371-38eb-485e-bad9-66f0425d105d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.182320 Sep 06 16:22:08.800130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 403/817] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:08 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:09.235172 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1d070282-31b0-4a68-bb91-d531b55473a8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:09.235808 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1d070282-31b0-4a68-bb91-d531b55473a8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:09.242994 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d070282-31b0-4a68-bb91-d531b55473a8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:09.243455 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d070282-31b0-4a68-bb91-d531b55473a8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:09.243884 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d070282-31b0-4a68-bb91-d531b55473a8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:09.244586 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d070282-31b0-4a68-bb91-d531b55473a8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:09.245068 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d070282-31b0-4a68-bb91-d531b55473a8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:09.245506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d070282-31b0-4a68-bb91-d531b55473a8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:09.377195 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:09.382162 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-1d070282-31b0-4a68-bb91-d531b55473a8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lazy-loading 'services' on Instance uuid 48c1a582-5bed-4ef1-8fac-a5e91cb17d73 {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:22:09.518472 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1d070282-31b0-4a68-bb91-d531b55473a8 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "DELETE /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73/os-volume_attachments/175fc7ec-f72b-4937-b603-fec470101db8" status: 202 len: 0 microversion: 2.1 time: 0.287094 Sep 06 16:22:09.519308 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 415/818] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 6 16:22:09 2022] DELETE /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73/os-volume_attachments/175fc7ec-f72b-4937-b603-fec470101db8 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:22:09.825253 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b8c6fa91-e798-4730-9c8b-2b14e6c44b85 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:09.825885 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b8c6fa91-e798-4730-9c8b-2b14e6c44b85 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:09.833732 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b8c6fa91-e798-4730-9c8b-2b14e6c44b85 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:09.834317 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b8c6fa91-e798-4730-9c8b-2b14e6c44b85 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:09.834748 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b8c6fa91-e798-4730-9c8b-2b14e6c44b85 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:09.835469 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b8c6fa91-e798-4730-9c8b-2b14e6c44b85 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:09.835925 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b8c6fa91-e798-4730-9c8b-2b14e6c44b85 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:09.836353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b8c6fa91-e798-4730-9c8b-2b14e6c44b85 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:10.001908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b8c6fa91-e798-4730-9c8b-2b14e6c44b85 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:10.010822 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b8c6fa91-e798-4730-9c8b-2b14e6c44b85 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.189938 Sep 06 16:22:10.011620 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 404/819] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:09 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:22:11.036529 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1d0d4065-6e74-4302-96be-55b9fb5a2075 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:11.037224 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1d0d4065-6e74-4302-96be-55b9fb5a2075 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:11.044396 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d0d4065-6e74-4302-96be-55b9fb5a2075 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:11.044922 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d0d4065-6e74-4302-96be-55b9fb5a2075 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:11.045351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d0d4065-6e74-4302-96be-55b9fb5a2075 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:11.046081 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d0d4065-6e74-4302-96be-55b9fb5a2075 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:11.046527 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d0d4065-6e74-4302-96be-55b9fb5a2075 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:11.046971 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1d0d4065-6e74-4302-96be-55b9fb5a2075 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:11.214328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1d0d4065-6e74-4302-96be-55b9fb5a2075 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:11.223051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1d0d4065-6e74-4302-96be-55b9fb5a2075 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.191429 Sep 06 16:22:11.223654 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 416/820] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:11 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:11.739339 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-57ac53fb-64b0-4df1-b251-a494eb9915c1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:11.740121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-57ac53fb-64b0-4df1-b251-a494eb9915c1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:11.742906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=4 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:11.749527 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57ac53fb-64b0-4df1-b251-a494eb9915c1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:11.750020 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57ac53fb-64b0-4df1-b251-a494eb9915c1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:11.750595 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57ac53fb-64b0-4df1-b251-a494eb9915c1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:11.751154 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57ac53fb-64b0-4df1-b251-a494eb9915c1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:11.751663 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57ac53fb-64b0-4df1-b251-a494eb9915c1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:11.752381 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57ac53fb-64b0-4df1-b251-a494eb9915c1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:11.757012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=71 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:11.789182 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-57ac53fb-64b0-4df1-b251-a494eb9915c1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Going to try to terminate instance {{(pid=120669) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:22:11.882110 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-57ac53fb-64b0-4df1-b251-a494eb9915c1 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "DELETE /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 204 len: 0 microversion: 2.1 time: 0.147288 Sep 06 16:22:11.882744 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 405/821] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:22:11 2022] DELETE /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:22:11.892373 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-552ddc84-75c4-4422-9e51-91aa5ae03669 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:11.893055 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-552ddc84-75c4-4422-9e51-91aa5ae03669 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:11.895228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=30 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:11.900041 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-552ddc84-75c4-4422-9e51-91aa5ae03669 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:11.900522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-552ddc84-75c4-4422-9e51-91aa5ae03669 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:11.900961 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-552ddc84-75c4-4422-9e51-91aa5ae03669 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:11.901651 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-552ddc84-75c4-4422-9e51-91aa5ae03669 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:11.902093 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-552ddc84-75c4-4422-9e51-91aa5ae03669 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:11.902505 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-552ddc84-75c4-4422-9e51-91aa5ae03669 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:12.043002 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-552ddc84-75c4-4422-9e51-91aa5ae03669 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:12.051567 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-552ddc84-75c4-4422-9e51-91aa5ae03669 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1514 microversion: 2.1 time: 0.163275 Sep 06 16:22:12.052127 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 417/822] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:11 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:12.248724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-91f28805-a3d8-426b-b3f2-8cdccb91e1e0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:12.249438 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-91f28805-a3d8-426b-b3f2-8cdccb91e1e0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:12.255961 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-91f28805-a3d8-426b-b3f2-8cdccb91e1e0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:12.256449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-91f28805-a3d8-426b-b3f2-8cdccb91e1e0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:12.256987 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-91f28805-a3d8-426b-b3f2-8cdccb91e1e0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:12.257707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-91f28805-a3d8-426b-b3f2-8cdccb91e1e0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:12.258149 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-91f28805-a3d8-426b-b3f2-8cdccb91e1e0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:12.258566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-91f28805-a3d8-426b-b3f2-8cdccb91e1e0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:12.419118 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-91f28805-a3d8-426b-b3f2-8cdccb91e1e0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:12.427740 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-91f28805-a3d8-426b-b3f2-8cdccb91e1e0 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.183269 Sep 06 16:22:12.428282 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 406/823] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:12 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:13.075889 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0f5d5d2c-099d-406d-a59f-1111a4be87aa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:13.076435 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0f5d5d2c-099d-406d-a59f-1111a4be87aa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:13.083620 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0f5d5d2c-099d-406d-a59f-1111a4be87aa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:13.084109 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0f5d5d2c-099d-406d-a59f-1111a4be87aa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:13.084663 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0f5d5d2c-099d-406d-a59f-1111a4be87aa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:13.085419 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0f5d5d2c-099d-406d-a59f-1111a4be87aa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:13.085866 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0f5d5d2c-099d-406d-a59f-1111a4be87aa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:13.086272 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0f5d5d2c-099d-406d-a59f-1111a4be87aa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:13.234080 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0f5d5d2c-099d-406d-a59f-1111a4be87aa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:13.242273 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0f5d5d2c-099d-406d-a59f-1111a4be87aa tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1514 microversion: 2.1 time: 0.170346 Sep 06 16:22:13.242854 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 418/824] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:13 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:13.452203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-386ca965-e346-44c2-8975-5ba451a4014b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:13.452790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-386ca965-e346-44c2-8975-5ba451a4014b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:13.460053 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-386ca965-e346-44c2-8975-5ba451a4014b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:13.460538 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-386ca965-e346-44c2-8975-5ba451a4014b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:13.460985 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-386ca965-e346-44c2-8975-5ba451a4014b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:13.461716 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-386ca965-e346-44c2-8975-5ba451a4014b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:13.462208 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-386ca965-e346-44c2-8975-5ba451a4014b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:13.462587 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-386ca965-e346-44c2-8975-5ba451a4014b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:13.616216 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-386ca965-e346-44c2-8975-5ba451a4014b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:13.625014 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-386ca965-e346-44c2-8975-5ba451a4014b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.176789 Sep 06 16:22:13.625561 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 407/825] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:13 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:14.266942 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c9e5be92-b6c0-40a0-aeff-05c1f9d45731 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:14.267667 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c9e5be92-b6c0-40a0-aeff-05c1f9d45731 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:14.275246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c9e5be92-b6c0-40a0-aeff-05c1f9d45731 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:14.275835 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c9e5be92-b6c0-40a0-aeff-05c1f9d45731 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:14.276277 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c9e5be92-b6c0-40a0-aeff-05c1f9d45731 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:14.277027 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c9e5be92-b6c0-40a0-aeff-05c1f9d45731 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:14.277486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c9e5be92-b6c0-40a0-aeff-05c1f9d45731 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:14.277890 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c9e5be92-b6c0-40a0-aeff-05c1f9d45731 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:14.422523 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c9e5be92-b6c0-40a0-aeff-05c1f9d45731 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:14.431668 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c9e5be92-b6c0-40a0-aeff-05c1f9d45731 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1514 microversion: 2.1 time: 0.168686 Sep 06 16:22:14.432254 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 419/826] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:14 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:14.652124 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b96749b4-8169-4fd6-a2d8-e982f1eb9a56 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:14.652710 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b96749b4-8169-4fd6-a2d8-e982f1eb9a56 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:14.660798 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b96749b4-8169-4fd6-a2d8-e982f1eb9a56 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:14.661276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b96749b4-8169-4fd6-a2d8-e982f1eb9a56 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:14.661837 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b96749b4-8169-4fd6-a2d8-e982f1eb9a56 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:14.662717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b96749b4-8169-4fd6-a2d8-e982f1eb9a56 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:14.663272 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b96749b4-8169-4fd6-a2d8-e982f1eb9a56 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:14.663791 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b96749b4-8169-4fd6-a2d8-e982f1eb9a56 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:14.945585 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b96749b4-8169-4fd6-a2d8-e982f1eb9a56 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:14.957165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b96749b4-8169-4fd6-a2d8-e982f1eb9a56 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.309214 Sep 06 16:22:14.966602 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 408/827] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:14 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:15.263826 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-5f4d323b-ba7b-4eb3-9cb8-02c899544707 req-e8d705dd-50a3-4629-a8e9-31e12da427f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c1a582-5bed-4ef1-8fac-a5e91cb17d73", "name": "network-vif-deleted", "tag": "f368bc3d-176b-4415-ac0a-e7fc574801f5"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:15.280467 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-5f4d323b-ba7b-4eb3-9cb8-02c899544707 req-e8d705dd-50a3-4629-a8e9-31e12da427f9 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:15.281010 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-5f4d323b-ba7b-4eb3-9cb8-02c899544707 req-e8d705dd-50a3-4629-a8e9-31e12da427f9 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:15.281521 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-5f4d323b-ba7b-4eb3-9cb8-02c899544707 req-e8d705dd-50a3-4629-a8e9-31e12da427f9 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:15.294545 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-5f4d323b-ba7b-4eb3-9cb8-02c899544707 req-e8d705dd-50a3-4629-a8e9-31e12da427f9 service nova] Creating event network-vif-deleted:f368bc3d-176b-4415-ac0a-e7fc574801f5 for instance 48c1a582-5bed-4ef1-8fac-a5e91cb17d73 on hv-cinder-85221 Sep 06 16:22:15.300354 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-5f4d323b-ba7b-4eb3-9cb8-02c899544707 req-e8d705dd-50a3-4629-a8e9-31e12da427f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042791 Sep 06 16:22:15.301067 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 420/828] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:15.456356 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:15.457151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:15.463395 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:15.463883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:15.464304 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:15.465020 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:15.465461 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:15.465911 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:15.500772 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:15.501268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:15.501693 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:15.502526 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lazy-loading 'fault' on Instance uuid 48c1a582-5bed-4ef1-8fac-a5e91cb17d73 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:22:15.554286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a6286db4945d4a052c40a5242d409', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e0b5bdccf44702b0490185476f88b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:15.563007 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5c269bbc-f80b-4e30-850e-8aa55be09551 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 200 len: 1308 microversion: 2.1 time: 0.111278 Sep 06 16:22:15.566749 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 409/829] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:15 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:15.984727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-255a0285-1903-442f-ad65-78884b4aa755 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:15.984727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-255a0285-1903-442f-ad65-78884b4aa755 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:15.989574 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-255a0285-1903-442f-ad65-78884b4aa755 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:15.990075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-255a0285-1903-442f-ad65-78884b4aa755 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:15.990494 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-255a0285-1903-442f-ad65-78884b4aa755 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:15.991198 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-255a0285-1903-442f-ad65-78884b4aa755 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:15.991640 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-255a0285-1903-442f-ad65-78884b4aa755 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:15.992061 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-255a0285-1903-442f-ad65-78884b4aa755 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:16.170337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-255a0285-1903-442f-ad65-78884b4aa755 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:16.178851 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-255a0285-1903-442f-ad65-78884b4aa755 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.201463 Sep 06 16:22:16.179783 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 421/830] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:15 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:16.590652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7f4a6957-4e37-4d4a-ad84-95b718397d90 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:16.591573 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7f4a6957-4e37-4d4a-ad84-95b718397d90 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] [instance: 48c1a582-5bed-4ef1-8fac-a5e91cb17d73] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:16.600330 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7f4a6957-4e37-4d4a-ad84-95b718397d90 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:16.601035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7f4a6957-4e37-4d4a-ad84-95b718397d90 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:16.601655 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7f4a6957-4e37-4d4a-ad84-95b718397d90 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:16.602698 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7f4a6957-4e37-4d4a-ad84-95b718397d90 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:16.603344 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7f4a6957-4e37-4d4a-ad84-95b718397d90 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:16.603964 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7f4a6957-4e37-4d4a-ad84-95b718397d90 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:16.620590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-7f4a6957-4e37-4d4a-ad84-95b718397d90 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] HTTP exception thrown: Instance 48c1a582-5bed-4ef1-8fac-a5e91cb17d73 could not be found. Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7f4a6957-4e37-4d4a-ad84-95b718397d90 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Request method failure captured: Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 HTTP/1.1 Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3LxKsFeHz7CUnTLvjspclPwmUSy-f3zj094rK785iBT6QTMZYxZ-8PIffWLpbNBn_I8E8XlhuClHMAfcxIsSVjwMBLyAvbMD8VPNlRgN10EjP-c69IV-wPeH721pop21zGRqsHUms0g3UmcPlvaRkJ-zXMzmNm-BnI7uynvLdr5AO8 Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 89e0b5bdccf44702b0490185476f88b3 Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesSnapshotTestJSON-198087087 Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:22:16.622295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:22:16.623679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89e0b5bdccf44702b0490185476f88b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89e0b5bdccf44702b0490185476f88b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_89e0b5bdccf44702b0490185476f88b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/89e0b5bdccf44702b0490185476f88b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:22:16.623679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesSnapshotTestJSON-198087087 Sep 06 16:22:16.623679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 89e0b5bdccf44702b0490185476f88b3 Sep 06 16:22:16.623679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-198087087 Sep 06 16:22:16.623679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesSnapshotTestJSON-198087087-project Sep 06 16:22:16.623679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:22:16.623679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:22:16.623679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: fd9a6286db4945d4a052c40a5242d409 Sep 06 16:22:16.623679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesSnapshotTestJSON-198087087-project Sep 06 16:22:16.623679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:22:16.623679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance 48c1a582-5bed-4ef1-8fac-a5e91cb17d73 could not be found. Sep 06 16:22:16.623679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': '48c1a582-5bed-4ef1-8fac-a5e91cb17d73'} Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c1a582-5bed-4ef1-8fac-a5e91cb17d73 could not be found. Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:22:16.624473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c1a582-5bed-4ef1-8fac-a5e91cb17d73 could not be found. Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c1a582-5bed-4ef1-8fac-a5e91cb17d73 could not be found. Sep 06 16:22:16.625815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:22:16.626972 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7f4a6957-4e37-4d4a-ad84-95b718397d90 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] Returning 404 to user: Instance 48c1a582-5bed-4ef1-8fac-a5e91cb17d73 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:22:16.626972 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7f4a6957-4e37-4d4a-ad84-95b718397d90 tempest-VolumesSnapshotTestJSON-198087087 tempest-VolumesSnapshotTestJSON-198087087-project] 10.222.0.43 "GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73" status: 404 len: 111 microversion: 2.1 time: 0.039157 Sep 06 16:22:16.626972 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 410/831] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:16 2022] GET /compute/v2.1/servers/48c1a582-5bed-4ef1-8fac-a5e91cb17d73 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:22:17.205091 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-166b1248-cc9c-4f77-9fa4-bba6a011deaf tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:17.205652 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-166b1248-cc9c-4f77-9fa4-bba6a011deaf tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:17.212908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-166b1248-cc9c-4f77-9fa4-bba6a011deaf tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:17.213404 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-166b1248-cc9c-4f77-9fa4-bba6a011deaf tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:17.213833 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-166b1248-cc9c-4f77-9fa4-bba6a011deaf tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:17.214540 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-166b1248-cc9c-4f77-9fa4-bba6a011deaf tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:17.215017 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-166b1248-cc9c-4f77-9fa4-bba6a011deaf tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:17.215437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-166b1248-cc9c-4f77-9fa4-bba6a011deaf tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:17.373096 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-166b1248-cc9c-4f77-9fa4-bba6a011deaf tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:17.382343 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-166b1248-cc9c-4f77-9fa4-bba6a011deaf tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1755 microversion: 2.1 time: 0.181074 Sep 06 16:22:17.383157 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 422/832] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:17 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:18.407263 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-63a46843-a513-441b-b12a-824e06fd7c37 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:18.407893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-63a46843-a513-441b-b12a-824e06fd7c37 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:18.414833 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-63a46843-a513-441b-b12a-824e06fd7c37 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:18.415326 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-63a46843-a513-441b-b12a-824e06fd7c37 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:18.415744 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-63a46843-a513-441b-b12a-824e06fd7c37 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:18.416427 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-63a46843-a513-441b-b12a-824e06fd7c37 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:18.416904 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-63a46843-a513-441b-b12a-824e06fd7c37 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:18.417323 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-63a46843-a513-441b-b12a-824e06fd7c37 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:18.571489 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-63a46843-a513-441b-b12a-824e06fd7c37 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:18.582958 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-63a46843-a513-441b-b12a-824e06fd7c37 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1758 microversion: 2.1 time: 0.179295 Sep 06 16:22:18.583552 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 411/833] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:18 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:34.176102 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1411925924", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-923325397", "security_groups": [{"name": "tempest-secgroup-smoke-1499775823"}], "block_device_mapping_v2": [{"uuid": "ddd31293-7575-4bd5-8988-e969b145bb1b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9a45d73a-863f-4a67-b2f9-bb887da40d25"}]}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:34.187764 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=11 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:34.188407 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:34.314100 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.network.neutron [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] validate_networks() for [('9a45d73a-863f-4a67-b2f9-bb887da40d25', None, None, None, None, None)] {{(pid=120668) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:22:34.814082 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Flavor limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:22:34.814530 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Image limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:22:34.814998 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Flavor pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:22:34.815400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Image pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:22:34.815801 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:22:34.825898 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:34.826378 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:34.826850 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:34.827524 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:34.827971 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:34.828386 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:34.846407 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Getting quotas for project f90ec559752b44b2b67c765488814865. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:22:34.850704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Getting quotas for user 4d3856b7bb7f4f5bb801952b893bbe35 and project f90ec559752b44b2b67c765488814865. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:22:34.912164 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Going to run 1 instances... {{(pid=120668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:22:34.914362 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddd31293-7575-4bd5-8988-e969b145bb1b',volume_size=None,volume_type=None)] {{(pid=120668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:22:35.048562 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [a2a9177d-4062-435b-b2a3-3831faa5b217] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 16:22:35.990569 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:22:35.991307 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Tue Sep 6 16:22:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Sep 06 16:22:36.057957 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO oslo.messaging._drivers.impl_rabbit [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [a2a9177d-4062-435b-b2a3-3831faa5b217] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 33930. Sep 06 16:22:36.062630 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a78748a8-b6e6-49b1-9d19-efafa2783740 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.890405 Sep 06 16:22:36.063289 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 423/834] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:22:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:22:36.074959 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-10049a67-7ade-4721-9f1d-43dbac4b016c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:36.075601 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-10049a67-7ade-4721-9f1d-43dbac4b016c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:36.078129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:36.078837 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:36.140228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-10049a67-7ade-4721-9f1d-43dbac4b016c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:36.147848 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-10049a67-7ade-4721-9f1d-43dbac4b016c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1094 microversion: 2.1 time: 0.076870 Sep 06 16:22:36.148548 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 412/835] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:36 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:37.172163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-74fca08c-f756-42ea-84bc-751c14e9a35b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:37.172794 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-74fca08c-f756-42ea-84bc-751c14e9a35b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:37.179495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-74fca08c-f756-42ea-84bc-751c14e9a35b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:37.179989 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-74fca08c-f756-42ea-84bc-751c14e9a35b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:37.180399 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-74fca08c-f756-42ea-84bc-751c14e9a35b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:37.181610 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-74fca08c-f756-42ea-84bc-751c14e9a35b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:37.182055 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-74fca08c-f756-42ea-84bc-751c14e9a35b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:37.182471 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-74fca08c-f756-42ea-84bc-751c14e9a35b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:37.248852 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-74fca08c-f756-42ea-84bc-751c14e9a35b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:37.257250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-74fca08c-f756-42ea-84bc-751c14e9a35b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1192 microversion: 2.1 time: 0.090258 Sep 06 16:22:37.257826 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 424/836] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:37 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:38.284603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e3a73aa8-4365-43ab-a1e6-d43f84839805 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:38.286040 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e3a73aa8-4365-43ab-a1e6-d43f84839805 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:38.295266 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e3a73aa8-4365-43ab-a1e6-d43f84839805 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:38.295924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e3a73aa8-4365-43ab-a1e6-d43f84839805 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:38.296784 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e3a73aa8-4365-43ab-a1e6-d43f84839805 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:38.297726 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e3a73aa8-4365-43ab-a1e6-d43f84839805 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:38.298419 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e3a73aa8-4365-43ab-a1e6-d43f84839805 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:38.298814 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e3a73aa8-4365-43ab-a1e6-d43f84839805 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:38.526410 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e3a73aa8-4365-43ab-a1e6-d43f84839805 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:38.534972 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e3a73aa8-4365-43ab-a1e6-d43f84839805 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1278 microversion: 2.1 time: 0.258879 Sep 06 16:22:38.535607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 413/837] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:38 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1278 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:39.220416 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-aac10af0-8480-4613-b757-b862ac445cad req-6ec05806-0f19-44ab-bf18-7b6dd12a8358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0542e187-d122-46db-bece-5aa1b888806a", "tag": "c7b5df75-8cd5-4802-8bc1-339b184f46df"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:39.232534 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-aac10af0-8480-4613-b757-b862ac445cad req-6ec05806-0f19-44ab-bf18-7b6dd12a8358 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:39.233267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-aac10af0-8480-4613-b757-b862ac445cad req-6ec05806-0f19-44ab-bf18-7b6dd12a8358 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:39.233977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-aac10af0-8480-4613-b757-b862ac445cad req-6ec05806-0f19-44ab-bf18-7b6dd12a8358 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:39.246559 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-aac10af0-8480-4613-b757-b862ac445cad req-6ec05806-0f19-44ab-bf18-7b6dd12a8358 service nova] Creating event network-changed:c7b5df75-8cd5-4802-8bc1-339b184f46df for instance 0542e187-d122-46db-bece-5aa1b888806a on hv-cinder-85221 Sep 06 16:22:39.254277 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-aac10af0-8480-4613-b757-b862ac445cad req-6ec05806-0f19-44ab-bf18-7b6dd12a8358 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037559 Sep 06 16:22:39.255496 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 425/838] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:22:39.559201 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f89f032f-ef0e-40b6-8c4b-744642d5e8a1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:39.559914 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f89f032f-ef0e-40b6-8c4b-744642d5e8a1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:39.566941 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f89f032f-ef0e-40b6-8c4b-744642d5e8a1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:39.567528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f89f032f-ef0e-40b6-8c4b-744642d5e8a1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:39.568039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f89f032f-ef0e-40b6-8c4b-744642d5e8a1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:39.569097 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f89f032f-ef0e-40b6-8c4b-744642d5e8a1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:39.569642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f89f032f-ef0e-40b6-8c4b-744642d5e8a1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:39.570124 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f89f032f-ef0e-40b6-8c4b-744642d5e8a1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:39.795115 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f89f032f-ef0e-40b6-8c4b-744642d5e8a1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:39.803376 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f89f032f-ef0e-40b6-8c4b-744642d5e8a1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.248715 Sep 06 16:22:39.803985 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 414/839] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:39 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:40.830211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-8aac5a74-ec0d-4c7f-a896-f1099a2a79fb tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:40.830844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-8aac5a74-ec0d-4c7f-a896-f1099a2a79fb tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:40.837600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8aac5a74-ec0d-4c7f-a896-f1099a2a79fb tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:40.838098 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8aac5a74-ec0d-4c7f-a896-f1099a2a79fb tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:40.838541 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8aac5a74-ec0d-4c7f-a896-f1099a2a79fb tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:40.839266 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8aac5a74-ec0d-4c7f-a896-f1099a2a79fb tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:40.839707 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8aac5a74-ec0d-4c7f-a896-f1099a2a79fb tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:40.840112 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8aac5a74-ec0d-4c7f-a896-f1099a2a79fb tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:40.991773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8aac5a74-ec0d-4c7f-a896-f1099a2a79fb tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:41.001584 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-8aac5a74-ec0d-4c7f-a896-f1099a2a79fb tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.176553 Sep 06 16:22:41.002168 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 426/840] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:40 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:42.027167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b92e4911-2d39-4019-8d72-560cc2ffa5e4 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:42.027784 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b92e4911-2d39-4019-8d72-560cc2ffa5e4 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:42.034819 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b92e4911-2d39-4019-8d72-560cc2ffa5e4 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:42.035331 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b92e4911-2d39-4019-8d72-560cc2ffa5e4 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:42.035785 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b92e4911-2d39-4019-8d72-560cc2ffa5e4 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:42.036701 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b92e4911-2d39-4019-8d72-560cc2ffa5e4 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:42.037097 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b92e4911-2d39-4019-8d72-560cc2ffa5e4 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:42.037545 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b92e4911-2d39-4019-8d72-560cc2ffa5e4 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:42.182623 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b92e4911-2d39-4019-8d72-560cc2ffa5e4 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:42.190658 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b92e4911-2d39-4019-8d72-560cc2ffa5e4 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.167608 Sep 06 16:22:42.191225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 415/841] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:42 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:43.213790 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-09498a24-399d-4f37-975d-4cddd57f18bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:43.214366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-09498a24-399d-4f37-975d-4cddd57f18bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:43.221287 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-09498a24-399d-4f37-975d-4cddd57f18bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:43.221769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-09498a24-399d-4f37-975d-4cddd57f18bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:43.222195 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-09498a24-399d-4f37-975d-4cddd57f18bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:43.222873 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-09498a24-399d-4f37-975d-4cddd57f18bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:43.223316 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-09498a24-399d-4f37-975d-4cddd57f18bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:43.223728 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-09498a24-399d-4f37-975d-4cddd57f18bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:43.361677 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-09498a24-399d-4f37-975d-4cddd57f18bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:43.370614 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-09498a24-399d-4f37-975d-4cddd57f18bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.160842 Sep 06 16:22:43.371204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 427/842] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:43 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:44.394472 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-effede5c-9f62-4343-ab01-4673ac08a2d6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:44.395096 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-effede5c-9f62-4343-ab01-4673ac08a2d6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:44.405797 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-effede5c-9f62-4343-ab01-4673ac08a2d6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:44.406287 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-effede5c-9f62-4343-ab01-4673ac08a2d6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:44.406723 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-effede5c-9f62-4343-ab01-4673ac08a2d6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:44.407434 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-effede5c-9f62-4343-ab01-4673ac08a2d6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:44.407877 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-effede5c-9f62-4343-ab01-4673ac08a2d6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:44.408332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-effede5c-9f62-4343-ab01-4673ac08a2d6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:44.546034 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-effede5c-9f62-4343-ab01-4673ac08a2d6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:44.554302 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-effede5c-9f62-4343-ab01-4673ac08a2d6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.164030 Sep 06 16:22:44.554870 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 416/843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:44 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:45.437302 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:45.438079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=6 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:45.557088 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-44f78461-811a-4891-ad7c-e6da113438e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a487c6e-4910-4bd8-868b-f99da22e97f4"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:45.559526 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-44f78461-811a-4891-ad7c-e6da113438e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:45.565920 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44f78461-811a-4891-ad7c-e6da113438e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:45.566399 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44f78461-811a-4891-ad7c-e6da113438e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:45.566822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44f78461-811a-4891-ad7c-e6da113438e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:45.567504 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44f78461-811a-4891-ad7c-e6da113438e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:45.567948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44f78461-811a-4891-ad7c-e6da113438e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:45.568363 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44f78461-811a-4891-ad7c-e6da113438e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:45.577965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ad9d97cd-947e-484d-b858-42f376397cc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:45.578550 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ad9d97cd-947e-484d-b858-42f376397cc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:45.585255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ad9d97cd-947e-484d-b858-42f376397cc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:45.585721 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ad9d97cd-947e-484d-b858-42f376397cc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:45.586145 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ad9d97cd-947e-484d-b858-42f376397cc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:45.586989 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ad9d97cd-947e-484d-b858-42f376397cc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:45.587786 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ad9d97cd-947e-484d-b858-42f376397cc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:45.588374 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ad9d97cd-947e-484d-b858-42f376397cc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:45.727927 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ad9d97cd-947e-484d-b858-42f376397cc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:45.736209 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ad9d97cd-947e-484d-b858-42f376397cc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.161957 Sep 06 16:22:45.736931 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 417/844] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:45 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:45.873448 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-44f78461-811a-4891-ad7c-e6da113438e0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "POST /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.441213 Sep 06 16:22:45.874212 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 428/845] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:22:45 2022] POST /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments => generated 194 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:46.761495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1d91c9b1-5953-4e98-85ee-44092fc46de3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:46.762081 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1d91c9b1-5953-4e98-85ee-44092fc46de3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:46.763939 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:46.770108 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d91c9b1-5953-4e98-85ee-44092fc46de3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:46.770596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d91c9b1-5953-4e98-85ee-44092fc46de3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:46.771021 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d91c9b1-5953-4e98-85ee-44092fc46de3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:46.771739 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d91c9b1-5953-4e98-85ee-44092fc46de3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:46.772162 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d91c9b1-5953-4e98-85ee-44092fc46de3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:46.772590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d91c9b1-5953-4e98-85ee-44092fc46de3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:46.914775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1d91c9b1-5953-4e98-85ee-44092fc46de3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:46.923533 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1d91c9b1-5953-4e98-85ee-44092fc46de3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.165980 Sep 06 16:22:46.924191 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 418/846] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:46 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:47.949121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a4cae584-63b2-4a57-bd33-4c18a8ccaa23 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:47.949794 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a4cae584-63b2-4a57-bd33-4c18a8ccaa23 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:47.956912 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4cae584-63b2-4a57-bd33-4c18a8ccaa23 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:47.957405 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4cae584-63b2-4a57-bd33-4c18a8ccaa23 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:47.957837 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4cae584-63b2-4a57-bd33-4c18a8ccaa23 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:47.958571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4cae584-63b2-4a57-bd33-4c18a8ccaa23 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:47.959029 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4cae584-63b2-4a57-bd33-4c18a8ccaa23 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:47.959452 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4cae584-63b2-4a57-bd33-4c18a8ccaa23 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:48.121163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a4cae584-63b2-4a57-bd33-4c18a8ccaa23 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:48.132626 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a4cae584-63b2-4a57-bd33-4c18a8ccaa23 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.188120 Sep 06 16:22:48.133983 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 429/847] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:47 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:49.157319 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d5a0b842-e732-4584-bb72-b56a7665156a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:49.157953 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d5a0b842-e732-4584-bb72-b56a7665156a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:49.164623 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d5a0b842-e732-4584-bb72-b56a7665156a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:49.165234 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d5a0b842-e732-4584-bb72-b56a7665156a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:49.165668 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d5a0b842-e732-4584-bb72-b56a7665156a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:49.166365 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d5a0b842-e732-4584-bb72-b56a7665156a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:49.166811 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d5a0b842-e732-4584-bb72-b56a7665156a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:49.167236 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d5a0b842-e732-4584-bb72-b56a7665156a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:49.303307 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d5a0b842-e732-4584-bb72-b56a7665156a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:49.311947 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d5a0b842-e732-4584-bb72-b56a7665156a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.158429 Sep 06 16:22:49.312529 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 419/848] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:49 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:50.340243 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fb1b52c5-c662-41f9-8daf-ab562a709e29 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:50.340884 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fb1b52c5-c662-41f9-8daf-ab562a709e29 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:50.347772 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb1b52c5-c662-41f9-8daf-ab562a709e29 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:50.348251 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb1b52c5-c662-41f9-8daf-ab562a709e29 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:50.348676 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb1b52c5-c662-41f9-8daf-ab562a709e29 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:50.349401 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb1b52c5-c662-41f9-8daf-ab562a709e29 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:50.349845 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb1b52c5-c662-41f9-8daf-ab562a709e29 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:50.350258 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb1b52c5-c662-41f9-8daf-ab562a709e29 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:50.490026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fb1b52c5-c662-41f9-8daf-ab562a709e29 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:50.498037 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fb1b52c5-c662-41f9-8daf-ab562a709e29 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.161767 Sep 06 16:22:50.498591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 430/849] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:50 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:51.519787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ce30f840-8afa-4afc-8e3d-d76272517f39 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:51.520375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ce30f840-8afa-4afc-8e3d-d76272517f39 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:51.526983 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce30f840-8afa-4afc-8e3d-d76272517f39 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:51.527492 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce30f840-8afa-4afc-8e3d-d76272517f39 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:51.528108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce30f840-8afa-4afc-8e3d-d76272517f39 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:51.528851 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce30f840-8afa-4afc-8e3d-d76272517f39 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:51.529308 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce30f840-8afa-4afc-8e3d-d76272517f39 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:51.529727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce30f840-8afa-4afc-8e3d-d76272517f39 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:51.629414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-400d41be-a056-410d-bdc6-f9428efc7a59 req-c9740a35-3a0d-4dec-9177-053f5d4b0519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0542e187-d122-46db-bece-5aa1b888806a", "name": "network-vif-plugged", "status": "completed", "tag": "c7b5df75-8cd5-4802-8bc1-339b184f46df"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:51.639219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-400d41be-a056-410d-bdc6-f9428efc7a59 req-c9740a35-3a0d-4dec-9177-053f5d4b0519 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:51.639722 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-400d41be-a056-410d-bdc6-f9428efc7a59 req-c9740a35-3a0d-4dec-9177-053f5d4b0519 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:51.640133 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-400d41be-a056-410d-bdc6-f9428efc7a59 req-c9740a35-3a0d-4dec-9177-053f5d4b0519 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:51.651957 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-400d41be-a056-410d-bdc6-f9428efc7a59 req-c9740a35-3a0d-4dec-9177-053f5d4b0519 service nova] Creating event network-vif-plugged:c7b5df75-8cd5-4802-8bc1-339b184f46df for instance 0542e187-d122-46db-bece-5aa1b888806a on hv-cinder-85221 Sep 06 16:22:51.657771 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-400d41be-a056-410d-bdc6-f9428efc7a59 req-c9740a35-3a0d-4dec-9177-053f5d4b0519 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237338 Sep 06 16:22:51.658393 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 420/850] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:51.673502 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ce30f840-8afa-4afc-8e3d-d76272517f39 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:51.682588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ce30f840-8afa-4afc-8e3d-d76272517f39 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.166534 Sep 06 16:22:51.683178 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 431/851] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:51 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:22:52.657287 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6ac40388-4f8d-4087-8b6b-c9c10ed0a819 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:52.658025 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6ac40388-4f8d-4087-8b6b-c9c10ed0a819 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:52.664663 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ac40388-4f8d-4087-8b6b-c9c10ed0a819 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:52.665214 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ac40388-4f8d-4087-8b6b-c9c10ed0a819 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:52.665654 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ac40388-4f8d-4087-8b6b-c9c10ed0a819 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:52.666327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ac40388-4f8d-4087-8b6b-c9c10ed0a819 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:52.666775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ac40388-4f8d-4087-8b6b-c9c10ed0a819 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:52.667193 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6ac40388-4f8d-4087-8b6b-c9c10ed0a819 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:52.705647 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b2e61b6f-8bb7-44e3-b52d-48cce522db77 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:52.706235 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b2e61b6f-8bb7-44e3-b52d-48cce522db77 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:52.714224 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2e61b6f-8bb7-44e3-b52d-48cce522db77 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:52.714718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2e61b6f-8bb7-44e3-b52d-48cce522db77 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:52.715150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2e61b6f-8bb7-44e3-b52d-48cce522db77 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:52.715848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2e61b6f-8bb7-44e3-b52d-48cce522db77 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:52.716318 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2e61b6f-8bb7-44e3-b52d-48cce522db77 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:52.716729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b2e61b6f-8bb7-44e3-b52d-48cce522db77 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:52.754545 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-6ac40388-4f8d-4087-8b6b-c9c10ed0a819 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lazy-loading 'services' on Instance uuid dbc140df-902e-4875-822f-53831e91b1c3 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:22:52.834607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6ac40388-4f8d-4087-8b6b-c9c10ed0a819 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/os-volume_attachments/59a768c5-e4cc-4c70-b478-288184a47f1e" status: 202 len: 0 microversion: 2.1 time: 0.185826 Sep 06 16:22:52.835602 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 421/852] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 6 16:22:52 2022] DELETE /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/os-volume_attachments/59a768c5-e4cc-4c70-b478-288184a47f1e => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:22:52.861502 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b2e61b6f-8bb7-44e3-b52d-48cce522db77 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:52.869668 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b2e61b6f-8bb7-44e3-b52d-48cce522db77 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.168004 Sep 06 16:22:52.870425 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 432/853] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:52 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:53.893906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fc9280cf-9d84-43eb-b646-c0e84b415679 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:53.894604 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fc9280cf-9d84-43eb-b646-c0e84b415679 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:53.902768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fc9280cf-9d84-43eb-b646-c0e84b415679 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:53.903259 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fc9280cf-9d84-43eb-b646-c0e84b415679 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:53.903810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fc9280cf-9d84-43eb-b646-c0e84b415679 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:53.904880 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fc9280cf-9d84-43eb-b646-c0e84b415679 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:53.904880 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fc9280cf-9d84-43eb-b646-c0e84b415679 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:53.905230 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fc9280cf-9d84-43eb-b646-c0e84b415679 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:54.053512 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fc9280cf-9d84-43eb-b646-c0e84b415679 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:54.063021 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fc9280cf-9d84-43eb-b646-c0e84b415679 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1266 microversion: 2.1 time: 0.173592 Sep 06 16:22:54.063811 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 422/854] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:53 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:55.086483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f5830b16-cd34-4180-8970-bbda31fa2e88 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:55.087123 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f5830b16-cd34-4180-8970-bbda31fa2e88 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:55.093879 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5830b16-cd34-4180-8970-bbda31fa2e88 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:55.094365 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5830b16-cd34-4180-8970-bbda31fa2e88 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:55.094800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5830b16-cd34-4180-8970-bbda31fa2e88 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:55.095492 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5830b16-cd34-4180-8970-bbda31fa2e88 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:55.095942 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5830b16-cd34-4180-8970-bbda31fa2e88 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:55.096348 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f5830b16-cd34-4180-8970-bbda31fa2e88 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:55.233564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f5830b16-cd34-4180-8970-bbda31fa2e88 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:55.241974 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f5830b16-cd34-4180-8970-bbda31fa2e88 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1453 microversion: 2.1 time: 0.159333 Sep 06 16:22:55.242563 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 433/855] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:55 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:55.264564 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b1b8ea53-8a65-49b6-8193-7a5492b5d2ea tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:55.265244 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b1b8ea53-8a65-49b6-8193-7a5492b5d2ea tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:55.272240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b1b8ea53-8a65-49b6-8193-7a5492b5d2ea tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:55.272721 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b1b8ea53-8a65-49b6-8193-7a5492b5d2ea tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:55.273178 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b1b8ea53-8a65-49b6-8193-7a5492b5d2ea tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:55.273876 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b1b8ea53-8a65-49b6-8193-7a5492b5d2ea tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:55.274368 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b1b8ea53-8a65-49b6-8193-7a5492b5d2ea tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:55.274786 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b1b8ea53-8a65-49b6-8193-7a5492b5d2ea tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:55.414597 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b1b8ea53-8a65-49b6-8193-7a5492b5d2ea tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:55.422741 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b1b8ea53-8a65-49b6-8193-7a5492b5d2ea tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1453 microversion: 2.1 time: 0.162005 Sep 06 16:22:55.423303 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 423/856] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:55 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:56.702716 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4869755d-ab90-4971-88e0-cbc104e6657f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:56.705016 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4869755d-ab90-4971-88e0-cbc104e6657f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:56.712212 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4869755d-ab90-4971-88e0-cbc104e6657f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:56.712696 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4869755d-ab90-4971-88e0-cbc104e6657f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:56.713155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4869755d-ab90-4971-88e0-cbc104e6657f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:56.713845 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4869755d-ab90-4971-88e0-cbc104e6657f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:56.714293 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4869755d-ab90-4971-88e0-cbc104e6657f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:56.714707 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4869755d-ab90-4971-88e0-cbc104e6657f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:56.738716 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-4869755d-ab90-4971-88e0-cbc104e6657f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lazy-loading 'flavor' on Instance uuid c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:22:56.878039 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4869755d-ab90-4971-88e0-cbc104e6657f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "POST /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/action" status: 200 len: 32 microversion: 2.1 time: 0.180183 Sep 06 16:22:56.878780 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 434/857] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:22:56 2022] POST /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:22:56.888373 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3fcee346-cbdc-4ca6-8921-7361cea8b5d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:56.889025 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-3fcee346-cbdc-4ca6-8921-7361cea8b5d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:56.895738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3fcee346-cbdc-4ca6-8921-7361cea8b5d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:56.896292 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3fcee346-cbdc-4ca6-8921-7361cea8b5d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:56.896630 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3fcee346-cbdc-4ca6-8921-7361cea8b5d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:56.897558 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3fcee346-cbdc-4ca6-8921-7361cea8b5d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:56.898184 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3fcee346-cbdc-4ca6-8921-7361cea8b5d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:56.898676 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3fcee346-cbdc-4ca6-8921-7361cea8b5d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:57.162487 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-80e3c40e-aff8-471f-8333-60bfb3ffdb7d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:57.170642 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-80e3c40e-aff8-471f-8333-60bfb3ffdb7d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:57.171134 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-80e3c40e-aff8-471f-8333-60bfb3ffdb7d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:57.171565 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-80e3c40e-aff8-471f-8333-60bfb3ffdb7d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:57.196125 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-80e3c40e-aff8-471f-8333-60bfb3ffdb7d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Going to try to stop instance {{(pid=120668) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 16:22:57.244112 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-80e3c40e-aff8-471f-8333-60bfb3ffdb7d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "POST /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/action" status: 202 len: 0 microversion: 2.1 time: 0.085604 Sep 06 16:22:57.245966 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 435/858] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:22:57 2022] POST /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:22:57.247428 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3fcee346-cbdc-4ca6-8921-7361cea8b5d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:57.259884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-3fcee346-cbdc-4ca6-8921-7361cea8b5d8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.375320 Sep 06 16:22:57.261033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 424/859] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:56 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:57.265529 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-8e4cecd4-7242-4199-877d-8de31a49ef2e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:57.266703 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-8e4cecd4-7242-4199-877d-8de31a49ef2e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:57.273265 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8e4cecd4-7242-4199-877d-8de31a49ef2e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:57.274271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8e4cecd4-7242-4199-877d-8de31a49ef2e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:57.274869 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8e4cecd4-7242-4199-877d-8de31a49ef2e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:57.275733 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8e4cecd4-7242-4199-877d-8de31a49ef2e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:57.276347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8e4cecd4-7242-4199-877d-8de31a49ef2e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:57.276948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8e4cecd4-7242-4199-877d-8de31a49ef2e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:57.306917 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:57.428276 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8e4cecd4-7242-4199-877d-8de31a49ef2e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:57.436332 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-8e4cecd4-7242-4199-877d-8de31a49ef2e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.181551 Sep 06 16:22:57.437090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 436/860] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:57 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:58.285127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d8c42df5-1bc6-4591-8629-40e9dcce17f2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:58.285756 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d8c42df5-1bc6-4591-8629-40e9dcce17f2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:58.293779 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8c42df5-1bc6-4591-8629-40e9dcce17f2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:58.294414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8c42df5-1bc6-4591-8629-40e9dcce17f2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:58.295055 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8c42df5-1bc6-4591-8629-40e9dcce17f2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:58.295821 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8c42df5-1bc6-4591-8629-40e9dcce17f2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:58.296345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8c42df5-1bc6-4591-8629-40e9dcce17f2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:58.296871 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d8c42df5-1bc6-4591-8629-40e9dcce17f2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:58.460111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7d90b29e-32d6-4d85-a870-32c073594c62 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:58.461049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7d90b29e-32d6-4d85-a870-32c073594c62 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:58.471339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d90b29e-32d6-4d85-a870-32c073594c62 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:58.471878 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d90b29e-32d6-4d85-a870-32c073594c62 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:58.472406 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d90b29e-32d6-4d85-a870-32c073594c62 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:58.473190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d90b29e-32d6-4d85-a870-32c073594c62 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:58.473702 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d90b29e-32d6-4d85-a870-32c073594c62 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:58.474184 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d90b29e-32d6-4d85-a870-32c073594c62 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:58.627100 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7d90b29e-32d6-4d85-a870-32c073594c62 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:58.637229 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7d90b29e-32d6-4d85-a870-32c073594c62 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.180674 Sep 06 16:22:58.641777 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d8c42df5-1bc6-4591-8629-40e9dcce17f2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:58.653394 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d8c42df5-1bc6-4591-8629-40e9dcce17f2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.372035 Sep 06 16:22:58.653623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 437/861] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:58 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:22:58.654713 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 425/862] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:58 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:58.658769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-35ace318-3815-4151-bc5e-abd84baf4add req-b6b967d9-4893-4fd2-a493-1d8443b55e23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0542e187-d122-46db-bece-5aa1b888806a", "tag": "c7b5df75-8cd5-4802-8bc1-339b184f46df"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:58.669199 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-35ace318-3815-4151-bc5e-abd84baf4add req-b6b967d9-4893-4fd2-a493-1d8443b55e23 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:58.669585 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-35ace318-3815-4151-bc5e-abd84baf4add req-b6b967d9-4893-4fd2-a493-1d8443b55e23 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:58.670012 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-35ace318-3815-4151-bc5e-abd84baf4add req-b6b967d9-4893-4fd2-a493-1d8443b55e23 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:58.682803 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-35ace318-3815-4151-bc5e-abd84baf4add req-b6b967d9-4893-4fd2-a493-1d8443b55e23 service nova] Creating event network-changed:c7b5df75-8cd5-4802-8bc1-339b184f46df for instance 0542e187-d122-46db-bece-5aa1b888806a on hv-cinder-85221 Sep 06 16:22:58.687811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-35ace318-3815-4151-bc5e-abd84baf4add req-b6b967d9-4893-4fd2-a493-1d8443b55e23 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032987 Sep 06 16:22:58.688422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 438/863] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:59.667532 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f5c39044-5959-4de7-a236-7d58a893d599 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:59.668867 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f5c39044-5959-4de7-a236-7d58a893d599 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:59.676416 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5c39044-5959-4de7-a236-7d58a893d599 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:59.676986 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5c39044-5959-4de7-a236-7d58a893d599 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:59.677528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5c39044-5959-4de7-a236-7d58a893d599 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:59.678440 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5c39044-5959-4de7-a236-7d58a893d599 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:59.678712 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-23e98a6f-092f-4220-8263-58a819ffa377 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:59.679409 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-23e98a6f-092f-4220-8263-58a819ffa377 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:59.679708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5c39044-5959-4de7-a236-7d58a893d599 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:59.681650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f5c39044-5959-4de7-a236-7d58a893d599 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:59.688151 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-23e98a6f-092f-4220-8263-58a819ffa377 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:59.688693 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-23e98a6f-092f-4220-8263-58a819ffa377 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:59.689164 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-23e98a6f-092f-4220-8263-58a819ffa377 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:59.689877 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-23e98a6f-092f-4220-8263-58a819ffa377 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:59.690310 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-23e98a6f-092f-4220-8263-58a819ffa377 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:59.690742 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-23e98a6f-092f-4220-8263-58a819ffa377 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:59.832455 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-23e98a6f-092f-4220-8263-58a819ffa377 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:59.837021 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f5c39044-5959-4de7-a236-7d58a893d599 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:59.841259 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-23e98a6f-092f-4220-8263-58a819ffa377 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.167723 Sep 06 16:22:59.841863 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 439/864] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:59 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:59.845219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f5c39044-5959-4de7-a236-7d58a893d599 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.181716 Sep 06 16:22:59.845795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 426/865] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:59 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:00.865468 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0c4af476-abed-4153-9c85-47a52681a2f0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:00.866044 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0c4af476-abed-4153-9c85-47a52681a2f0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:00.867640 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6cd0056d-ef3e-43bf-8315-20197aac75c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:00.868244 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6cd0056d-ef3e-43bf-8315-20197aac75c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:00.873576 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0c4af476-abed-4153-9c85-47a52681a2f0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:00.874062 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0c4af476-abed-4153-9c85-47a52681a2f0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:00.874528 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0c4af476-abed-4153-9c85-47a52681a2f0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:00.875223 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0c4af476-abed-4153-9c85-47a52681a2f0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:00.875670 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0c4af476-abed-4153-9c85-47a52681a2f0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:00.875834 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cd0056d-ef3e-43bf-8315-20197aac75c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:00.876091 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0c4af476-abed-4153-9c85-47a52681a2f0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:00.876237 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cd0056d-ef3e-43bf-8315-20197aac75c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:00.876710 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cd0056d-ef3e-43bf-8315-20197aac75c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:00.877760 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cd0056d-ef3e-43bf-8315-20197aac75c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:00.878629 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cd0056d-ef3e-43bf-8315-20197aac75c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:00.879083 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cd0056d-ef3e-43bf-8315-20197aac75c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:01.019459 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6cd0056d-ef3e-43bf-8315-20197aac75c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:01.020049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0c4af476-abed-4153-9c85-47a52681a2f0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:01.030835 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6cd0056d-ef3e-43bf-8315-20197aac75c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.166795 Sep 06 16:23:01.031718 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 427/866] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:00 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:01.031936 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0c4af476-abed-4153-9c85-47a52681a2f0 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.170470 Sep 06 16:23:01.032990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 440/867] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:00 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:02.057951 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9aabc6ab-83f2-489b-afa3-70791de5c4db tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:02.058579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b699e7af-86b0-42c0-aa7e-962ac0b8a3f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:02.058985 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9aabc6ab-83f2-489b-afa3-70791de5c4db tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:02.059089 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b699e7af-86b0-42c0-aa7e-962ac0b8a3f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:02.065864 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b699e7af-86b0-42c0-aa7e-962ac0b8a3f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:02.066104 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9aabc6ab-83f2-489b-afa3-70791de5c4db tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:02.066358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9aabc6ab-83f2-489b-afa3-70791de5c4db tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:02.066526 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b699e7af-86b0-42c0-aa7e-962ac0b8a3f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:02.066789 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b699e7af-86b0-42c0-aa7e-962ac0b8a3f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:02.066955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9aabc6ab-83f2-489b-afa3-70791de5c4db tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:02.067495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9aabc6ab-83f2-489b-afa3-70791de5c4db tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:02.067653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b699e7af-86b0-42c0-aa7e-962ac0b8a3f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:02.067959 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9aabc6ab-83f2-489b-afa3-70791de5c4db tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:02.068117 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b699e7af-86b0-42c0-aa7e-962ac0b8a3f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:02.068486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b699e7af-86b0-42c0-aa7e-962ac0b8a3f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:02.069300 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9aabc6ab-83f2-489b-afa3-70791de5c4db tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:02.213259 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b699e7af-86b0-42c0-aa7e-962ac0b8a3f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:02.216535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9aabc6ab-83f2-489b-afa3-70791de5c4db tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:02.221890 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b699e7af-86b0-42c0-aa7e-962ac0b8a3f9 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.169009 Sep 06 16:23:02.222613 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 441/868] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:02 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:02.225217 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9aabc6ab-83f2-489b-afa3-70791de5c4db tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.172591 Sep 06 16:23:02.225910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 428/869] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:02 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:03.246779 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ee36e899-5ba7-44c9-ad34-2ab90e0678f8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:03.248256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ee36e899-5ba7-44c9-ad34-2ab90e0678f8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:03.249017 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a6d58d13-cdec-4145-8a49-19fdf9baaf95 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:03.249627 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a6d58d13-cdec-4145-8a49-19fdf9baaf95 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:03.256545 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ee36e899-5ba7-44c9-ad34-2ab90e0678f8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:03.256812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6d58d13-cdec-4145-8a49-19fdf9baaf95 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:03.257049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ee36e899-5ba7-44c9-ad34-2ab90e0678f8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:03.257171 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6d58d13-cdec-4145-8a49-19fdf9baaf95 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:03.257479 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6d58d13-cdec-4145-8a49-19fdf9baaf95 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:03.257634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ee36e899-5ba7-44c9-ad34-2ab90e0678f8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:03.258277 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6d58d13-cdec-4145-8a49-19fdf9baaf95 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:03.258423 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ee36e899-5ba7-44c9-ad34-2ab90e0678f8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:03.258722 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6d58d13-cdec-4145-8a49-19fdf9baaf95 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:03.258899 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ee36e899-5ba7-44c9-ad34-2ab90e0678f8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:03.259149 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6d58d13-cdec-4145-8a49-19fdf9baaf95 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:03.259308 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ee36e899-5ba7-44c9-ad34-2ab90e0678f8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:03.282776 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:03.398860 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a6d58d13-cdec-4145-8a49-19fdf9baaf95 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:03.400550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ee36e899-5ba7-44c9-ad34-2ab90e0678f8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:03.407842 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a6d58d13-cdec-4145-8a49-19fdf9baaf95 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.162686 Sep 06 16:23:03.408470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 429/870] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:03 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:03.409162 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ee36e899-5ba7-44c9-ad34-2ab90e0678f8 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.166539 Sep 06 16:23:03.409844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 442/871] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:03 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:23:04.432302 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-da8fcaaf-93da-4598-9e48-a4bcebc6754e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:04.432916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-da8fcaaf-93da-4598-9e48-a4bcebc6754e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:04.433701 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a42a2941-e588-4710-b754-aab5ca3af34f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:04.434280 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a42a2941-e588-4710-b754-aab5ca3af34f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:04.436805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:04.439812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da8fcaaf-93da-4598-9e48-a4bcebc6754e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:04.440304 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da8fcaaf-93da-4598-9e48-a4bcebc6754e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:04.440736 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da8fcaaf-93da-4598-9e48-a4bcebc6754e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:04.441502 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da8fcaaf-93da-4598-9e48-a4bcebc6754e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:04.441945 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da8fcaaf-93da-4598-9e48-a4bcebc6754e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:04.442511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da8fcaaf-93da-4598-9e48-a4bcebc6754e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:04.443214 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a42a2941-e588-4710-b754-aab5ca3af34f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:04.443804 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a42a2941-e588-4710-b754-aab5ca3af34f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:04.444250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a42a2941-e588-4710-b754-aab5ca3af34f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:04.444955 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a42a2941-e588-4710-b754-aab5ca3af34f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:04.445403 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a42a2941-e588-4710-b754-aab5ca3af34f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:04.445817 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a42a2941-e588-4710-b754-aab5ca3af34f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:04.580703 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a42a2941-e588-4710-b754-aab5ca3af34f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:04.588176 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-da8fcaaf-93da-4598-9e48-a4bcebc6754e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:04.590993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a42a2941-e588-4710-b754-aab5ca3af34f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.161543 Sep 06 16:23:04.591582 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 443/872] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:04 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:04.597366 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-da8fcaaf-93da-4598-9e48-a4bcebc6754e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.169514 Sep 06 16:23:04.597942 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 430/873] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:04 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:05.616705 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3201818e-b6cd-497b-8ba1-71e8f8b2729b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:05.617325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3201818e-b6cd-497b-8ba1-71e8f8b2729b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:05.620688 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-65fa38a4-34c3-4bbd-9d41-759b47203d2f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:05.621345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-65fa38a4-34c3-4bbd-9d41-759b47203d2f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:05.624215 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3201818e-b6cd-497b-8ba1-71e8f8b2729b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:05.624723 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3201818e-b6cd-497b-8ba1-71e8f8b2729b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:05.625211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3201818e-b6cd-497b-8ba1-71e8f8b2729b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:05.625902 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3201818e-b6cd-497b-8ba1-71e8f8b2729b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:05.626343 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3201818e-b6cd-497b-8ba1-71e8f8b2729b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:05.626759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3201818e-b6cd-497b-8ba1-71e8f8b2729b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:05.628142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-65fa38a4-34c3-4bbd-9d41-759b47203d2f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:05.628613 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-65fa38a4-34c3-4bbd-9d41-759b47203d2f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:05.629079 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-65fa38a4-34c3-4bbd-9d41-759b47203d2f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:05.629759 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-65fa38a4-34c3-4bbd-9d41-759b47203d2f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:05.630204 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-65fa38a4-34c3-4bbd-9d41-759b47203d2f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:05.630623 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-65fa38a4-34c3-4bbd-9d41-759b47203d2f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:05.767770 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-65fa38a4-34c3-4bbd-9d41-759b47203d2f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:05.770605 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3201818e-b6cd-497b-8ba1-71e8f8b2729b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:05.776262 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-65fa38a4-34c3-4bbd-9d41-759b47203d2f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.159335 Sep 06 16:23:05.776869 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 431/874] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:05 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:05.779839 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3201818e-b6cd-497b-8ba1-71e8f8b2729b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.167954 Sep 06 16:23:05.780408 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 444/875] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:05 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:06.800210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f00e8c65-acce-4dec-bbf7-82ed567aa001 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:06.800856 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f00e8c65-acce-4dec-bbf7-82ed567aa001 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:06.803259 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=43 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:06.806659 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4505ede6-bfe7-4ce5-959f-7508bcaaf526 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:06.807412 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4505ede6-bfe7-4ce5-959f-7508bcaaf526 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:06.810098 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f00e8c65-acce-4dec-bbf7-82ed567aa001 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:06.810593 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f00e8c65-acce-4dec-bbf7-82ed567aa001 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:06.811012 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f00e8c65-acce-4dec-bbf7-82ed567aa001 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:06.811712 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f00e8c65-acce-4dec-bbf7-82ed567aa001 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:06.812158 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f00e8c65-acce-4dec-bbf7-82ed567aa001 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:06.812595 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f00e8c65-acce-4dec-bbf7-82ed567aa001 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:06.814515 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4505ede6-bfe7-4ce5-959f-7508bcaaf526 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:06.814996 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4505ede6-bfe7-4ce5-959f-7508bcaaf526 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:06.815426 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4505ede6-bfe7-4ce5-959f-7508bcaaf526 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:06.816140 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4505ede6-bfe7-4ce5-959f-7508bcaaf526 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:06.816585 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4505ede6-bfe7-4ce5-959f-7508bcaaf526 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:06.817023 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4505ede6-bfe7-4ce5-959f-7508bcaaf526 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:06.951597 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4505ede6-bfe7-4ce5-959f-7508bcaaf526 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:06.955720 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f00e8c65-acce-4dec-bbf7-82ed567aa001 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:06.960954 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4505ede6-bfe7-4ce5-959f-7508bcaaf526 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.158845 Sep 06 16:23:06.961556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 445/876] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:06 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:06.963769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f00e8c65-acce-4dec-bbf7-82ed567aa001 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.167399 Sep 06 16:23:06.968545 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 432/877] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:06 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:07.988139 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-76198762-96d0-4f00-97cb-d4245dd86f27 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:07.989433 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-76198762-96d0-4f00-97cb-d4245dd86f27 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:07.998458 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76198762-96d0-4f00-97cb-d4245dd86f27 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:07.999056 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76198762-96d0-4f00-97cb-d4245dd86f27 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:07.999554 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76198762-96d0-4f00-97cb-d4245dd86f27 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:08.000353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-78eba4f7-2574-4a03-8a69-3b8bdaeadc23 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:08.000842 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76198762-96d0-4f00-97cb-d4245dd86f27 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:08.000962 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-78eba4f7-2574-4a03-8a69-3b8bdaeadc23 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:08.001272 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76198762-96d0-4f00-97cb-d4245dd86f27 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:08.001828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76198762-96d0-4f00-97cb-d4245dd86f27 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:08.007881 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78eba4f7-2574-4a03-8a69-3b8bdaeadc23 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:08.008369 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78eba4f7-2574-4a03-8a69-3b8bdaeadc23 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:08.008824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78eba4f7-2574-4a03-8a69-3b8bdaeadc23 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:08.009525 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78eba4f7-2574-4a03-8a69-3b8bdaeadc23 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:08.009976 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78eba4f7-2574-4a03-8a69-3b8bdaeadc23 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:08.010415 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78eba4f7-2574-4a03-8a69-3b8bdaeadc23 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:08.143750 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-76198762-96d0-4f00-97cb-d4245dd86f27 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:08.153091 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-76198762-96d0-4f00-97cb-d4245dd86f27 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.170922 Sep 06 16:23:08.153727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 446/878] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:07 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:08.165967 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-78eba4f7-2574-4a03-8a69-3b8bdaeadc23 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:08.175038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-78eba4f7-2574-4a03-8a69-3b8bdaeadc23 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.178447 Sep 06 16:23:08.175623 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 433/879] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:07 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:09.178269 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ef01e9d4-d742-4f24-a3f1-a7ca22d16f3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:09.179556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ef01e9d4-d742-4f24-a3f1-a7ca22d16f3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:09.190095 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ef01e9d4-d742-4f24-a3f1-a7ca22d16f3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:09.190880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ef01e9d4-d742-4f24-a3f1-a7ca22d16f3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:09.191436 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ef01e9d4-d742-4f24-a3f1-a7ca22d16f3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:09.192519 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ef01e9d4-d742-4f24-a3f1-a7ca22d16f3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:09.193060 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ef01e9d4-d742-4f24-a3f1-a7ca22d16f3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:09.193484 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ef01e9d4-d742-4f24-a3f1-a7ca22d16f3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:09.199199 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e764a0a0-7d74-4564-ba88-11f05d318aad tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:09.199802 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e764a0a0-7d74-4564-ba88-11f05d318aad tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:09.206685 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e764a0a0-7d74-4564-ba88-11f05d318aad tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:09.207168 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e764a0a0-7d74-4564-ba88-11f05d318aad tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:09.207593 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e764a0a0-7d74-4564-ba88-11f05d318aad tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:09.208290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e764a0a0-7d74-4564-ba88-11f05d318aad tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:09.208724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e764a0a0-7d74-4564-ba88-11f05d318aad tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:09.209190 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e764a0a0-7d74-4564-ba88-11f05d318aad tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:09.345795 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ef01e9d4-d742-4f24-a3f1-a7ca22d16f3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:09.347708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e764a0a0-7d74-4564-ba88-11f05d318aad tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:09.355085 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ef01e9d4-d742-4f24-a3f1-a7ca22d16f3c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.180907 Sep 06 16:23:09.355675 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 447/880] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:09 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:09.356281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e764a0a0-7d74-4564-ba88-11f05d318aad tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.161042 Sep 06 16:23:09.356876 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 434/881] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:09 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:10.379053 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f7aa9c99-2ab9-40fa-82e5-5ffce76d8a35 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:10.379971 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f7aa9c99-2ab9-40fa-82e5-5ffce76d8a35 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:10.380246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-29398f84-6cf4-4390-bb40-165c7bd1c7fa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:10.380726 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-29398f84-6cf4-4390-bb40-165c7bd1c7fa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:10.387190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f7aa9c99-2ab9-40fa-82e5-5ffce76d8a35 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:10.387660 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f7aa9c99-2ab9-40fa-82e5-5ffce76d8a35 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:10.388183 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f7aa9c99-2ab9-40fa-82e5-5ffce76d8a35 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:10.388836 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f7aa9c99-2ab9-40fa-82e5-5ffce76d8a35 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:10.389298 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f7aa9c99-2ab9-40fa-82e5-5ffce76d8a35 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:10.389700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f7aa9c99-2ab9-40fa-82e5-5ffce76d8a35 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:10.389806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-29398f84-6cf4-4390-bb40-165c7bd1c7fa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:10.390287 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-29398f84-6cf4-4390-bb40-165c7bd1c7fa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:10.390744 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-29398f84-6cf4-4390-bb40-165c7bd1c7fa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:10.391450 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-29398f84-6cf4-4390-bb40-165c7bd1c7fa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:10.391902 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-29398f84-6cf4-4390-bb40-165c7bd1c7fa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:10.392330 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-29398f84-6cf4-4390-bb40-165c7bd1c7fa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:10.533452 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f7aa9c99-2ab9-40fa-82e5-5ffce76d8a35 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:10.548675 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-29398f84-6cf4-4390-bb40-165c7bd1c7fa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:10.549417 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f7aa9c99-2ab9-40fa-82e5-5ffce76d8a35 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.174011 Sep 06 16:23:10.554349 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 448/882] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:10 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:10.557901 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-29398f84-6cf4-4390-bb40-165c7bd1c7fa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.182436 Sep 06 16:23:10.558452 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 435/883] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:10 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:11.579766 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ffde7569-a555-4127-a776-fa796cf187a2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:11.580410 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ffde7569-a555-4127-a776-fa796cf187a2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:11.580912 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-38efc488-2419-4406-920a-4109c6dc8583 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:11.581522 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-38efc488-2419-4406-920a-4109c6dc8583 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:11.587660 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ffde7569-a555-4127-a776-fa796cf187a2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:11.588155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ffde7569-a555-4127-a776-fa796cf187a2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:11.588389 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38efc488-2419-4406-920a-4109c6dc8583 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:11.588554 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ffde7569-a555-4127-a776-fa796cf187a2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:11.588923 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38efc488-2419-4406-920a-4109c6dc8583 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:11.589281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ffde7569-a555-4127-a776-fa796cf187a2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:11.589456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38efc488-2419-4406-920a-4109c6dc8583 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:11.589716 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ffde7569-a555-4127-a776-fa796cf187a2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:11.590078 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38efc488-2419-4406-920a-4109c6dc8583 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:11.590234 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ffde7569-a555-4127-a776-fa796cf187a2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:11.590547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38efc488-2419-4406-920a-4109c6dc8583 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:11.591002 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38efc488-2419-4406-920a-4109c6dc8583 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:11.735042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ffde7569-a555-4127-a776-fa796cf187a2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:11.747047 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ffde7569-a555-4127-a776-fa796cf187a2 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.171163 Sep 06 16:23:11.747815 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 449/884] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:11 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:11.771894 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-38efc488-2419-4406-920a-4109c6dc8583 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:11.783172 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-38efc488-2419-4406-920a-4109c6dc8583 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.206101 Sep 06 16:23:11.783747 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 436/885] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:11 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:12.772929 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4073a904-8d6b-47cf-9b31-d45a138260c5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:12.773567 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4073a904-8d6b-47cf-9b31-d45a138260c5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:12.780634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4073a904-8d6b-47cf-9b31-d45a138260c5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:12.781157 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4073a904-8d6b-47cf-9b31-d45a138260c5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:12.781588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4073a904-8d6b-47cf-9b31-d45a138260c5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:12.782288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4073a904-8d6b-47cf-9b31-d45a138260c5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:12.782735 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4073a904-8d6b-47cf-9b31-d45a138260c5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:12.783154 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4073a904-8d6b-47cf-9b31-d45a138260c5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:12.808881 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9f32ee56-330d-49ae-ae9b-b0322c594b84 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:12.809494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9f32ee56-330d-49ae-ae9b-b0322c594b84 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:12.816491 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9f32ee56-330d-49ae-ae9b-b0322c594b84 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:12.817011 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9f32ee56-330d-49ae-ae9b-b0322c594b84 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:12.817441 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9f32ee56-330d-49ae-ae9b-b0322c594b84 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:12.818168 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9f32ee56-330d-49ae-ae9b-b0322c594b84 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:12.818608 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9f32ee56-330d-49ae-ae9b-b0322c594b84 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:12.819023 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9f32ee56-330d-49ae-ae9b-b0322c594b84 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:12.962500 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4073a904-8d6b-47cf-9b31-d45a138260c5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:12.972263 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9f32ee56-330d-49ae-ae9b-b0322c594b84 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:12.980975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9f32ee56-330d-49ae-ae9b-b0322c594b84 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1679 microversion: 2.1 time: 0.177313 Sep 06 16:23:12.981603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 437/886] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:12 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:12.982135 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4073a904-8d6b-47cf-9b31-d45a138260c5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1735 microversion: 2.1 time: 0.212793 Sep 06 16:23:12.983116 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 450/887] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:12 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:14.005761 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-570fbe82-0ccd-4276-a689-9f5351b593c9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:14.006571 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-570fbe82-0ccd-4276-a689-9f5351b593c9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:14.011436 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e2d4cf22-4843-4dc4-b8a5-7c1690a16f0f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:14.012080 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e2d4cf22-4843-4dc4-b8a5-7c1690a16f0f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:14.013356 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-570fbe82-0ccd-4276-a689-9f5351b593c9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.013876 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-570fbe82-0ccd-4276-a689-9f5351b593c9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.014310 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-570fbe82-0ccd-4276-a689-9f5351b593c9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.015015 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-570fbe82-0ccd-4276-a689-9f5351b593c9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.015481 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-570fbe82-0ccd-4276-a689-9f5351b593c9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.015880 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-570fbe82-0ccd-4276-a689-9f5351b593c9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.018770 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e2d4cf22-4843-4dc4-b8a5-7c1690a16f0f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.019262 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e2d4cf22-4843-4dc4-b8a5-7c1690a16f0f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.019699 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e2d4cf22-4843-4dc4-b8a5-7c1690a16f0f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.020401 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e2d4cf22-4843-4dc4-b8a5-7c1690a16f0f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.020893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e2d4cf22-4843-4dc4-b8a5-7c1690a16f0f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.021319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e2d4cf22-4843-4dc4-b8a5-7c1690a16f0f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.159308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-570fbe82-0ccd-4276-a689-9f5351b593c9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:14.159499 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e2d4cf22-4843-4dc4-b8a5-7c1690a16f0f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:14.171127 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e2d4cf22-4843-4dc4-b8a5-7c1690a16f0f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1715 microversion: 2.1 time: 0.163502 Sep 06 16:23:14.171684 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 451/888] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:14 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:14.172734 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-570fbe82-0ccd-4276-a689-9f5351b593c9 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1656 microversion: 2.1 time: 0.170883 Sep 06 16:23:14.173340 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 438/889] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:14 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1656 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:14.196552 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fd62fc8e-5c57-4405-bb10-248a966332c3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:14.203398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fd62fc8e-5c57-4405-bb10-248a966332c3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.203876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fd62fc8e-5c57-4405-bb10-248a966332c3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.204280 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fd62fc8e-5c57-4405-bb10-248a966332c3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.230033 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fd62fc8e-5c57-4405-bb10-248a966332c3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Going to try to start instance {{(pid=120668) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 16:23:14.272087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:14.286045 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fd62fc8e-5c57-4405-bb10-248a966332c3 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "POST /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/action" status: 202 len: 0 microversion: 2.1 time: 0.094044 Sep 06 16:23:14.286651 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 452/890] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:23:14 2022] POST /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:23:14.295894 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7bbe4b40-0041-45cd-a745-c854cb4a8afc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:14.296504 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7bbe4b40-0041-45cd-a745-c854cb4a8afc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:14.299348 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-69ec4275-5014-4084-9632-ccdadc8e6ab5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:14.299929 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-69ec4275-5014-4084-9632-ccdadc8e6ab5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:14.303950 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7bbe4b40-0041-45cd-a745-c854cb4a8afc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.304652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7bbe4b40-0041-45cd-a745-c854cb4a8afc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.305493 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7bbe4b40-0041-45cd-a745-c854cb4a8afc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.306456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7bbe4b40-0041-45cd-a745-c854cb4a8afc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.307056 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7bbe4b40-0041-45cd-a745-c854cb4a8afc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.307748 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7bbe4b40-0041-45cd-a745-c854cb4a8afc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.308262 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-69ec4275-5014-4084-9632-ccdadc8e6ab5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.308744 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-69ec4275-5014-4084-9632-ccdadc8e6ab5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.309212 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-69ec4275-5014-4084-9632-ccdadc8e6ab5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.309924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-69ec4275-5014-4084-9632-ccdadc8e6ab5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.310923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-69ec4275-5014-4084-9632-ccdadc8e6ab5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.310923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-69ec4275-5014-4084-9632-ccdadc8e6ab5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.419066 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-69ec4275-5014-4084-9632-ccdadc8e6ab5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] HTTP exception thrown: Cannot 'detach_volume' instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 while it is in vm_state rescued Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-69ec4275-5014-4084-9632-ccdadc8e6ab5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Request method failure captured: Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: DELETE /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments/4a487c6e-4910-4bd8-868b-f99da22e97f4 HTTP/1.1 Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3JE-mvXJfafJGdfInwGWFXyX8vm1TCi2ot3YdwYrF-4Edt8_xnBZLKdft-iOh0bGqcZkuWHUjnbHFyY4JyAcYYwqblm10OkwpxcwVN1Q9ztdopxT5kE1EybmUKrN1PEAiAMDv4KZA1PhL7NR0vL4LK6Q15ypGJ6vu_af7tN1gEPvCI Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 49a3e0cfba224a119bf8aaf26ae583f4 Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:23:14.420704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:23:14.422111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:23:14.422111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:23:14.422111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 49a3e0cfba224a119bf8aaf26ae583f4 Sep 06 16:23:14.422111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:23:14.422111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-ServerRescueNegativeTestJSON-843887898-project Sep 06 16:23:14.422111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:23:14.422111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:23:14.422111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 93096a58fcb34f2085a05ffa40df5937 Sep 06 16:23:14.422111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-ServerRescueNegativeTestJSON-843887898-project Sep 06 16:23:14.422111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:23:14.422111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Cannot 'detach_volume' instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 while it is in vm_state rescued Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'server_id': 'c0ff1c2e-7944-4480-8fe9-47bf5417cbd6', 'id': '4a487c6e-4910-4bd8-868b-f99da22e97f4'} Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:23:14.422802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 while it is in vm_state rescued Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 while it is in vm_state rescued Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:23:14.424087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-69ec4275-5014-4084-9632-ccdadc8e6ab5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Returning 409 to user: Cannot 'detach_volume' instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 while it is in vm_state rescued {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:23:14.425183 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-69ec4275-5014-4084-9632-ccdadc8e6ab5 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments/4a487c6e-4910-4bd8-868b-f99da22e97f4" status: 409 len: 152 microversion: 2.1 time: 0.127218 Sep 06 16:23:14.425183 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 453/891] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 6 16:23:14 2022] DELETE /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments/4a487c6e-4910-4bd8-868b-f99da22e97f4 => generated 152 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 06 16:23:14.431732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-160114b5-3dd2-4825-94b7-3acf2a87e7d4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:14.432345 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-160114b5-3dd2-4825-94b7-3acf2a87e7d4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:14.439215 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-160114b5-3dd2-4825-94b7-3acf2a87e7d4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.439758 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-160114b5-3dd2-4825-94b7-3acf2a87e7d4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.440180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-160114b5-3dd2-4825-94b7-3acf2a87e7d4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.440904 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-160114b5-3dd2-4825-94b7-3acf2a87e7d4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.441379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-160114b5-3dd2-4825-94b7-3acf2a87e7d4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.441755 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-160114b5-3dd2-4825-94b7-3acf2a87e7d4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.518845 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-160114b5-3dd2-4825-94b7-3acf2a87e7d4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "POST /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/action" status: 202 len: 0 microversion: 2.1 time: 0.091125 Sep 06 16:23:14.521775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7bbe4b40-0041-45cd-a745-c854cb4a8afc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:14.523848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 454/892] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:23:14 2022] POST /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 16:23:14.529542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-60dfa07c-a433-417b-8a52-f8eed8cb0195 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:14.530250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-60dfa07c-a433-417b-8a52-f8eed8cb0195 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:14.530966 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7bbe4b40-0041-45cd-a745-c854cb4a8afc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1665 microversion: 2.1 time: 0.239323 Sep 06 16:23:14.532801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 439/893] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:14 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1665 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:23:14.537001 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60dfa07c-a433-417b-8a52-f8eed8cb0195 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.537561 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60dfa07c-a433-417b-8a52-f8eed8cb0195 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.538079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60dfa07c-a433-417b-8a52-f8eed8cb0195 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.538861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60dfa07c-a433-417b-8a52-f8eed8cb0195 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.539401 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60dfa07c-a433-417b-8a52-f8eed8cb0195 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.539965 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-60dfa07c-a433-417b-8a52-f8eed8cb0195 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.685600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-60dfa07c-a433-417b-8a52-f8eed8cb0195 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:14.694304 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-60dfa07c-a433-417b-8a52-f8eed8cb0195 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1723 microversion: 2.1 time: 0.168912 Sep 06 16:23:14.694897 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 455/894] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:14 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:14.772047 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-202c8b93-5076-4a75-a1c8-af605055b4f0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:14.772549 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-202c8b93-5076-4a75-a1c8-af605055b4f0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:14.782731 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-202c8b93-5076-4a75-a1c8-af605055b4f0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.783156 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-202c8b93-5076-4a75-a1c8-af605055b4f0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.783578 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-202c8b93-5076-4a75-a1c8-af605055b4f0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.784320 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-202c8b93-5076-4a75-a1c8-af605055b4f0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.784779 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-202c8b93-5076-4a75-a1c8-af605055b4f0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.785202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-202c8b93-5076-4a75-a1c8-af605055b4f0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.822902 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-202c8b93-5076-4a75-a1c8-af605055b4f0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments/ba276d4b-6c10-4e81-96bf-c8dea6ee0e4e" status: 200 len: 194 microversion: 2.20 time: 0.054855 Sep 06 16:23:14.823688 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 440/895] 10.222.0.43 () {60 vars in 1454 bytes} [Tue Sep 6 16:23:14 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments/ba276d4b-6c10-4e81-96bf-c8dea6ee0e4e => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:23:14.897518 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-de7e67a4-8e99-4201-8a9d-128d92dffdc1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:14.898018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-de7e67a4-8e99-4201-8a9d-128d92dffdc1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:14.904377 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-de7e67a4-8e99-4201-8a9d-128d92dffdc1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.905083 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-de7e67a4-8e99-4201-8a9d-128d92dffdc1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.905522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-de7e67a4-8e99-4201-8a9d-128d92dffdc1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.906226 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-de7e67a4-8e99-4201-8a9d-128d92dffdc1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.906676 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-de7e67a4-8e99-4201-8a9d-128d92dffdc1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.907117 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-de7e67a4-8e99-4201-8a9d-128d92dffdc1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.995319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-de7e67a4-8e99-4201-8a9d-128d92dffdc1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lazy-loading 'services' on Instance uuid b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:23:15.094467 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-de7e67a4-8e99-4201-8a9d-128d92dffdc1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments/ba276d4b-6c10-4e81-96bf-c8dea6ee0e4e" status: 202 len: 0 microversion: 2.20 time: 0.200842 Sep 06 16:23:15.099120 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 456/896] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Sep 6 16:23:14 2022] DELETE /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments/ba276d4b-6c10-4e81-96bf-c8dea6ee0e4e => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:23:15.105493 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a3f5e893-08ab-4111-bf7f-e38ffb548a76 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:15.108810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a3f5e893-08ab-4111-bf7f-e38ffb548a76 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:15.116339 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a3f5e893-08ab-4111-bf7f-e38ffb548a76 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:15.116919 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a3f5e893-08ab-4111-bf7f-e38ffb548a76 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:15.117552 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a3f5e893-08ab-4111-bf7f-e38ffb548a76 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:15.118346 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a3f5e893-08ab-4111-bf7f-e38ffb548a76 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:15.119637 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a3f5e893-08ab-4111-bf7f-e38ffb548a76 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:15.119637 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a3f5e893-08ab-4111-bf7f-e38ffb548a76 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:15.153362 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a3f5e893-08ab-4111-bf7f-e38ffb548a76 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052570 Sep 06 16:23:15.158610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 441/897] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Sep 6 16:23:15 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:23:15.557672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-97b8594b-efb9-4c7f-bd19-9e4960ec054d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:15.558383 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-97b8594b-efb9-4c7f-bd19-9e4960ec054d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:15.565007 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-97b8594b-efb9-4c7f-bd19-9e4960ec054d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:15.565491 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-97b8594b-efb9-4c7f-bd19-9e4960ec054d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:15.565912 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-97b8594b-efb9-4c7f-bd19-9e4960ec054d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:15.566599 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-97b8594b-efb9-4c7f-bd19-9e4960ec054d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:15.567049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-97b8594b-efb9-4c7f-bd19-9e4960ec054d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:15.567469 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-97b8594b-efb9-4c7f-bd19-9e4960ec054d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:15.704811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-97b8594b-efb9-4c7f-bd19-9e4960ec054d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:15.718808 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d86899ab-2746-451e-aaec-69cfa6752e0b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:15.719394 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d86899ab-2746-451e-aaec-69cfa6752e0b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:15.724030 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-97b8594b-efb9-4c7f-bd19-9e4960ec054d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1665 microversion: 2.1 time: 0.171579 Sep 06 16:23:15.724746 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 457/898] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:15 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1665 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:15.726934 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d86899ab-2746-451e-aaec-69cfa6752e0b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:15.727797 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d86899ab-2746-451e-aaec-69cfa6752e0b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:15.728229 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d86899ab-2746-451e-aaec-69cfa6752e0b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:15.729008 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d86899ab-2746-451e-aaec-69cfa6752e0b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:15.729458 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d86899ab-2746-451e-aaec-69cfa6752e0b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:15.730043 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d86899ab-2746-451e-aaec-69cfa6752e0b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:15.882979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d86899ab-2746-451e-aaec-69cfa6752e0b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:15.891900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d86899ab-2746-451e-aaec-69cfa6752e0b tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1723 microversion: 2.1 time: 0.176980 Sep 06 16:23:15.892481 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 442/899] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:15 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:16.166271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6caacfa7-56ca-4db2-b515-c59aba7de545 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:16.168581 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6caacfa7-56ca-4db2-b515-c59aba7de545 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:16.175415 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6caacfa7-56ca-4db2-b515-c59aba7de545 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:16.175909 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6caacfa7-56ca-4db2-b515-c59aba7de545 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:16.176337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6caacfa7-56ca-4db2-b515-c59aba7de545 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:16.177114 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6caacfa7-56ca-4db2-b515-c59aba7de545 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:16.177565 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6caacfa7-56ca-4db2-b515-c59aba7de545 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:16.177982 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6caacfa7-56ca-4db2-b515-c59aba7de545 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:16.210268 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6caacfa7-56ca-4db2-b515-c59aba7de545 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048058 Sep 06 16:23:16.210833 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 458/900] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Sep 6 16:23:16 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:23:16.749935 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f24e718d-b55d-4257-bb13-d562db0c0687 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:16.750519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f24e718d-b55d-4257-bb13-d562db0c0687 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:16.757640 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f24e718d-b55d-4257-bb13-d562db0c0687 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:16.758123 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f24e718d-b55d-4257-bb13-d562db0c0687 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:16.758661 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f24e718d-b55d-4257-bb13-d562db0c0687 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:16.759358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f24e718d-b55d-4257-bb13-d562db0c0687 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:16.759788 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f24e718d-b55d-4257-bb13-d562db0c0687 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:16.760205 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f24e718d-b55d-4257-bb13-d562db0c0687 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:16.909792 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f24e718d-b55d-4257-bb13-d562db0c0687 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:16.915634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-bdabe578-fd48-420d-adfc-0547b0d1125a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:16.916267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-bdabe578-fd48-420d-adfc-0547b0d1125a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:16.918836 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f24e718d-b55d-4257-bb13-d562db0c0687 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1669 microversion: 2.1 time: 0.173959 Sep 06 16:23:16.919415 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 443/901] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:16 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:16.925752 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bdabe578-fd48-420d-adfc-0547b0d1125a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:16.926241 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bdabe578-fd48-420d-adfc-0547b0d1125a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:16.926685 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bdabe578-fd48-420d-adfc-0547b0d1125a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:16.927387 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bdabe578-fd48-420d-adfc-0547b0d1125a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:16.927830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bdabe578-fd48-420d-adfc-0547b0d1125a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:16.928240 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bdabe578-fd48-420d-adfc-0547b0d1125a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:17.066854 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-bdabe578-fd48-420d-adfc-0547b0d1125a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:17.078008 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-bdabe578-fd48-420d-adfc-0547b0d1125a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1723 microversion: 2.1 time: 0.166240 Sep 06 16:23:17.078455 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 459/902] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:16 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:17.223533 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fba74f46-2af5-4cff-ab9a-0ab87cb54108 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:17.225788 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fba74f46-2af5-4cff-ab9a-0ab87cb54108 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:17.232652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fba74f46-2af5-4cff-ab9a-0ab87cb54108 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:17.233160 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fba74f46-2af5-4cff-ab9a-0ab87cb54108 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:17.233587 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fba74f46-2af5-4cff-ab9a-0ab87cb54108 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:17.234282 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fba74f46-2af5-4cff-ab9a-0ab87cb54108 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:17.234722 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fba74f46-2af5-4cff-ab9a-0ab87cb54108 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:17.235138 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fba74f46-2af5-4cff-ab9a-0ab87cb54108 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:17.267127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fba74f46-2af5-4cff-ab9a-0ab87cb54108 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047587 Sep 06 16:23:17.267713 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 444/903] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Sep 6 16:23:17 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:23:18.103938 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3502462d-aec4-4579-bedf-2c2c74ac793e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:18.104584 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3502462d-aec4-4579-bedf-2c2c74ac793e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:18.111564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3502462d-aec4-4579-bedf-2c2c74ac793e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:18.112062 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3502462d-aec4-4579-bedf-2c2c74ac793e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:18.112495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3502462d-aec4-4579-bedf-2c2c74ac793e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:18.113247 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3502462d-aec4-4579-bedf-2c2c74ac793e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:18.113685 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3502462d-aec4-4579-bedf-2c2c74ac793e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:18.114118 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3502462d-aec4-4579-bedf-2c2c74ac793e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:18.250607 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3502462d-aec4-4579-bedf-2c2c74ac793e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:18.260241 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3502462d-aec4-4579-bedf-2c2c74ac793e tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1723 microversion: 2.1 time: 0.160318 Sep 06 16:23:18.260879 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 460/904] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:18 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:18.280601 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b69d3539-465c-4da2-b51d-ccb3a93e3ca1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:18.282878 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b69d3539-465c-4da2-b51d-ccb3a93e3ca1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:18.289656 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b69d3539-465c-4da2-b51d-ccb3a93e3ca1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:18.290242 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b69d3539-465c-4da2-b51d-ccb3a93e3ca1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:18.290674 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b69d3539-465c-4da2-b51d-ccb3a93e3ca1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:18.291358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b69d3539-465c-4da2-b51d-ccb3a93e3ca1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:18.291810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b69d3539-465c-4da2-b51d-ccb3a93e3ca1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:18.292224 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b69d3539-465c-4da2-b51d-ccb3a93e3ca1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:18.325836 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b69d3539-465c-4da2-b51d-ccb3a93e3ca1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049388 Sep 06 16:23:18.326417 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 445/905] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Sep 6 16:23:18 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 16:23:19.283742 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9980ecb2-0057-4445-a381-9435be7318f1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:19.284326 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9980ecb2-0057-4445-a381-9435be7318f1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:19.291571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9980ecb2-0057-4445-a381-9435be7318f1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:19.292053 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9980ecb2-0057-4445-a381-9435be7318f1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:19.292516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9980ecb2-0057-4445-a381-9435be7318f1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:19.293445 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9980ecb2-0057-4445-a381-9435be7318f1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:19.293895 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9980ecb2-0057-4445-a381-9435be7318f1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:19.294311 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9980ecb2-0057-4445-a381-9435be7318f1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:19.340033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-991c7c1c-f3f6-4a4b-b9a7-4f64607096da tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:19.342286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-991c7c1c-f3f6-4a4b-b9a7-4f64607096da tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:19.348923 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-991c7c1c-f3f6-4a4b-b9a7-4f64607096da tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:19.349404 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-991c7c1c-f3f6-4a4b-b9a7-4f64607096da tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:19.349842 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-991c7c1c-f3f6-4a4b-b9a7-4f64607096da tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:19.350641 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-991c7c1c-f3f6-4a4b-b9a7-4f64607096da tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:19.351187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-991c7c1c-f3f6-4a4b-b9a7-4f64607096da tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:19.351510 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-991c7c1c-f3f6-4a4b-b9a7-4f64607096da tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:19.355589 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:19.382332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-991c7c1c-f3f6-4a4b-b9a7-4f64607096da tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046514 Sep 06 16:23:19.383145 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 446/906] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Sep 6 16:23:19 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:19.431417 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9980ecb2-0057-4445-a381-9435be7318f1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:19.440006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9980ecb2-0057-4445-a381-9435be7318f1 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1729 microversion: 2.1 time: 0.160171 Sep 06 16:23:19.440586 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 461/907] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:19 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:19.450026 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-310b8067-afb4-40be-8270-dc80c023b9de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:19.450529 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-310b8067-afb4-40be-8270-dc80c023b9de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:19.456485 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-310b8067-afb4-40be-8270-dc80c023b9de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:19.456973 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-310b8067-afb4-40be-8270-dc80c023b9de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:19.457418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-310b8067-afb4-40be-8270-dc80c023b9de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:19.458088 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-310b8067-afb4-40be-8270-dc80c023b9de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:19.458532 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-310b8067-afb4-40be-8270-dc80c023b9de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:19.459052 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-310b8067-afb4-40be-8270-dc80c023b9de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:19.462849 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-cee475dd-558e-4ac3-a518-95afae3f239c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:19.463358 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-cee475dd-558e-4ac3-a518-95afae3f239c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:19.469358 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cee475dd-558e-4ac3-a518-95afae3f239c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:19.469872 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cee475dd-558e-4ac3-a518-95afae3f239c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:19.470282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cee475dd-558e-4ac3-a518-95afae3f239c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:19.471001 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cee475dd-558e-4ac3-a518-95afae3f239c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:19.471449 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cee475dd-558e-4ac3-a518-95afae3f239c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:19.471864 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cee475dd-558e-4ac3-a518-95afae3f239c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:19.484817 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-310b8067-afb4-40be-8270-dc80c023b9de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Going to try to terminate instance {{(pid=120669) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:23:19.567072 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-cee475dd-558e-4ac3-a518-95afae3f239c tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108115 Sep 06 16:23:19.568079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 462/908] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 6 16:23:19 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:23:19.587242 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-310b8067-afb4-40be-8270-dc80c023b9de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 204 len: 0 microversion: 2.20 time: 0.140816 Sep 06 16:23:19.587844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 447/909] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Sep 6 16:23:19 2022] DELETE /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 16:23:19.596600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-64f8fde9-0674-453c-af9e-d18883c73d3d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:19.597292 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-64f8fde9-0674-453c-af9e-d18883c73d3d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:19.603802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-64f8fde9-0674-453c-af9e-d18883c73d3d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:19.604301 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-64f8fde9-0674-453c-af9e-d18883c73d3d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:19.604729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-64f8fde9-0674-453c-af9e-d18883c73d3d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:19.605452 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-64f8fde9-0674-453c-af9e-d18883c73d3d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:19.605896 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-64f8fde9-0674-453c-af9e-d18883c73d3d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:19.606313 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-64f8fde9-0674-453c-af9e-d18883c73d3d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:19.841386 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-64f8fde9-0674-453c-af9e-d18883c73d3d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:19.850345 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-64f8fde9-0674-453c-af9e-d18883c73d3d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:19.851783 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-64f8fde9-0674-453c-af9e-d18883c73d3d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:19.853420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-64f8fde9-0674-453c-af9e-d18883c73d3d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.260770 Sep 06 16:23:19.854014 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 463/910] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:19 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:20.866901 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-affed286-8086-439b-9cdd-bfe9f7938799 req-85474a97-89bf-489a-ac75-7b3af76bc1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ff1c2e-7944-4480-8fe9-47bf5417cbd6", "tag": "72ac5ea6-8d72-4bdb-9f41-ad02915d59c5"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:20.877521 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-affed286-8086-439b-9cdd-bfe9f7938799 req-85474a97-89bf-489a-ac75-7b3af76bc1c4 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:20.878186 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-affed286-8086-439b-9cdd-bfe9f7938799 req-85474a97-89bf-489a-ac75-7b3af76bc1c4 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:20.878588 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-affed286-8086-439b-9cdd-bfe9f7938799 req-85474a97-89bf-489a-ac75-7b3af76bc1c4 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:20.879254 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-492d74e7-7430-47bb-bbc0-4951e2023f57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:20.879898 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-492d74e7-7430-47bb-bbc0-4951e2023f57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:20.887007 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-492d74e7-7430-47bb-bbc0-4951e2023f57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:20.887899 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-492d74e7-7430-47bb-bbc0-4951e2023f57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:20.888338 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-492d74e7-7430-47bb-bbc0-4951e2023f57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:20.889072 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-492d74e7-7430-47bb-bbc0-4951e2023f57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:20.889541 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-492d74e7-7430-47bb-bbc0-4951e2023f57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:20.889972 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-492d74e7-7430-47bb-bbc0-4951e2023f57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:20.891796 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-affed286-8086-439b-9cdd-bfe9f7938799 req-85474a97-89bf-489a-ac75-7b3af76bc1c4 service nova] Creating event network-changed:72ac5ea6-8d72-4bdb-9f41-ad02915d59c5 for instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 on hv-cinder-85221 Sep 06 16:23:20.897194 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-affed286-8086-439b-9cdd-bfe9f7938799 req-85474a97-89bf-489a-ac75-7b3af76bc1c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106263 Sep 06 16:23:20.898075 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 448/911] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:21.027614 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-492d74e7-7430-47bb-bbc0-4951e2023f57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:21.036377 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-492d74e7-7430-47bb-bbc0-4951e2023f57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:21.037855 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-492d74e7-7430-47bb-bbc0-4951e2023f57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:21.039038 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-492d74e7-7430-47bb-bbc0-4951e2023f57 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.163900 Sep 06 16:23:21.039702 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 464/912] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:20 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:23:22.066264 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-52bd91d1-5ae1-4d3b-b327-aac3d767b04e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:22.066960 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-52bd91d1-5ae1-4d3b-b327-aac3d767b04e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:22.074063 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-52bd91d1-5ae1-4d3b-b327-aac3d767b04e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:22.074553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-52bd91d1-5ae1-4d3b-b327-aac3d767b04e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:22.074979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-52bd91d1-5ae1-4d3b-b327-aac3d767b04e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:22.075678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-52bd91d1-5ae1-4d3b-b327-aac3d767b04e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:22.076150 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-52bd91d1-5ae1-4d3b-b327-aac3d767b04e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:22.076566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-52bd91d1-5ae1-4d3b-b327-aac3d767b04e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:22.458416 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-52bd91d1-5ae1-4d3b-b327-aac3d767b04e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:22.467439 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-52bd91d1-5ae1-4d3b-b327-aac3d767b04e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:22.468906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-52bd91d1-5ae1-4d3b-b327-aac3d767b04e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:22.470053 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-52bd91d1-5ae1-4d3b-b327-aac3d767b04e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1723 microversion: 2.20 time: 0.408656 Sep 06 16:23:22.470617 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 449/913] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:22 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1723 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:22.915325 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-0af0214a-235b-45b5-8629-cacd6384c64e req-dd053444-e1bf-4a14-aa67-c9bca8e8bd20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ff1c2e-7944-4480-8fe9-47bf5417cbd6", "tag": "72ac5ea6-8d72-4bdb-9f41-ad02915d59c5"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:22.925505 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-0af0214a-235b-45b5-8629-cacd6384c64e req-dd053444-e1bf-4a14-aa67-c9bca8e8bd20 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:22.925991 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-0af0214a-235b-45b5-8629-cacd6384c64e req-dd053444-e1bf-4a14-aa67-c9bca8e8bd20 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:22.926468 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-0af0214a-235b-45b5-8629-cacd6384c64e req-dd053444-e1bf-4a14-aa67-c9bca8e8bd20 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:22.938714 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-0af0214a-235b-45b5-8629-cacd6384c64e req-dd053444-e1bf-4a14-aa67-c9bca8e8bd20 service nova] Creating event network-changed:72ac5ea6-8d72-4bdb-9f41-ad02915d59c5 for instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 on hv-cinder-85221 Sep 06 16:23:22.943880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-0af0214a-235b-45b5-8629-cacd6384c64e req-dd053444-e1bf-4a14-aa67-c9bca8e8bd20 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034622 Sep 06 16:23:22.944834 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 465/914] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:23.497480 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-43f56d2c-bd41-4638-966e-357e97b75313 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:23.498802 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-43f56d2c-bd41-4638-966e-357e97b75313 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:23.509686 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43f56d2c-bd41-4638-966e-357e97b75313 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:23.510411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43f56d2c-bd41-4638-966e-357e97b75313 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:23.511188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43f56d2c-bd41-4638-966e-357e97b75313 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:23.512158 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43f56d2c-bd41-4638-966e-357e97b75313 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:23.512907 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43f56d2c-bd41-4638-966e-357e97b75313 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:23.513418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-43f56d2c-bd41-4638-966e-357e97b75313 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:23.541594 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-9b174064-60c4-4a99-965d-7e87613fee1b req-006bbc00-af66-4ae5-bb59-237f89725cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2", "name": "network-vif-deleted", "tag": "4b0a3d0f-c85a-40a8-b906-23e0735edd5e"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:23.559928 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-9b174064-60c4-4a99-965d-7e87613fee1b req-006bbc00-af66-4ae5-bb59-237f89725cf6 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:23.560436 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-9b174064-60c4-4a99-965d-7e87613fee1b req-006bbc00-af66-4ae5-bb59-237f89725cf6 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:23.560859 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-9b174064-60c4-4a99-965d-7e87613fee1b req-006bbc00-af66-4ae5-bb59-237f89725cf6 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:23.574003 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-9b174064-60c4-4a99-965d-7e87613fee1b req-006bbc00-af66-4ae5-bb59-237f89725cf6 service nova] Creating event network-vif-deleted:4b0a3d0f-c85a-40a8-b906-23e0735edd5e for instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 on hv-cinder-85221 Sep 06 16:23:23.582028 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-9b174064-60c4-4a99-965d-7e87613fee1b req-006bbc00-af66-4ae5-bb59-237f89725cf6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049280 Sep 06 16:23:23.582948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 466/915] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:23.652994 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-43f56d2c-bd41-4638-966e-357e97b75313 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:23.661642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-43f56d2c-bd41-4638-966e-357e97b75313 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:23.663122 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-43f56d2c-bd41-4638-966e-357e97b75313 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:23.664367 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-43f56d2c-bd41-4638-966e-357e97b75313 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 200 len: 1655 microversion: 2.20 time: 0.171906 Sep 06 16:23:23.665501 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 450/916] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:23 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 1655 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:24.695746 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f27ec8d1-ac34-463b-a888-ae243e7044eb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:24.696298 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f27ec8d1-ac34-463b-a888-ae243e7044eb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:24.703157 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f27ec8d1-ac34-463b-a888-ae243e7044eb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:24.703652 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f27ec8d1-ac34-463b-a888-ae243e7044eb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:24.704086 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f27ec8d1-ac34-463b-a888-ae243e7044eb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:24.704909 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f27ec8d1-ac34-463b-a888-ae243e7044eb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:24.705380 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f27ec8d1-ac34-463b-a888-ae243e7044eb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:24.705806 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f27ec8d1-ac34-463b-a888-ae243e7044eb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:24.722091 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-f27ec8d1-ac34-463b-a888-ae243e7044eb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] HTTP exception thrown: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f27ec8d1-ac34-463b-a888-ae243e7044eb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Request method failure captured: Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 HTTP/1.1 Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3I9lyVSeED3DDoPWBRB7NaLIrHgPsEvdQxaRV43JQRFLPSldfzp4ALAKeTQt8A6df3mhMVda_KWDA6NAn_Mgu-35PX3-Zh3vs8qDbdcVLHIWaruPsYMMNtp_gnsKzbjvFwvSY60mVr5GAQaNo70W-h3TO1rK6wyaOOhuFcMIJYWG4M Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 8b93a6978c404ca4aa497919103b5283 Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:23:24.723759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:23:24.725459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b93a6978c404ca4aa497919103b5283"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:23:24.725459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:23:24.725459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 8b93a6978c404ca4aa497919103b5283 Sep 06 16:23:24.725459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:23:24.725459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeShelveTestJSON-902753663-project Sep 06 16:23:24.725459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:23:24.725459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:23:24.725459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: c3a65f26ab214feab60c7b6380539076 Sep 06 16:23:24.725459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902753663-project Sep 06 16:23:24.725459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:23:24.725459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:23:24.725459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2'} Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:23:24.726328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:23:24.727571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:23:24.728904 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f27ec8d1-ac34-463b-a888-ae243e7044eb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Returning 404 to user: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:23:24.728904 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f27ec8d1-ac34-463b-a888-ae243e7044eb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 404 len: 111 microversion: 2.20 time: 0.034775 Sep 06 16:23:24.728904 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 467/917] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:24 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:23:24.735935 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-647848c7-438e-4c4a-b57f-72c67366aa0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '.version_select at 0x7f83ecd863a0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:24.757809 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-647848c7-438e-4c4a-b57f-72c67366aa0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721304744" status: 204 len: 0 microversion: 2.20 time: 0.025719 Sep 06 16:23:24.759000 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 451/918] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Sep 6 16:23:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721304744 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 16:23:25.478493 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2379dde0-3418-4e42-a8ac-a8ade82d8848 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Action: 'create', calling method: .version_select at 0x7f83e93f9b80>, body: {"keypair": {"name": "tempest-keypair-2044582468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXvvStiVy4AXfh4D5hKmoFGi23eEbnsybkSeNAjDmjH5R6V0SvqTvGYb9qAENmprRWerz3MerZxwNwSoX90eC4I5mEN8IgW/i0IfuOYxrtu62Rr/DkKy2A3Ep7qZtTQgw=="}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:25.496306 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-2379dde0-3418-4e42-a8ac-a8ade82d8848 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Getting quotas for project 8b93a6978c404ca4aa497919103b5283. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:23:25.500369 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-2379dde0-3418-4e42-a8ac-a8ade82d8848 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Getting quotas for user c3a65f26ab214feab60c7b6380539076 and project 8b93a6978c404ca4aa497919103b5283. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:23:25.531784 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2379dde0-3418-4e42-a8ac-a8ade82d8848 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.057306 Sep 06 16:23:25.532581 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 468/919] 10.222.0.43 () {62 vars in 1200 bytes} [Tue Sep 6 16:23:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 16:23:26.905383 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-944401145", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e00a66dc-f0ca-4fcd-9aa2-b28b6fad62d0"}], "security_groups": [{"name": "tempest-securitygroup--1253403175"}], "key_name": "tempest-keypair-2044582468", "user_data": "}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:27.014337 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] validate_networks() for [('e00a66dc-f0ca-4fcd-9aa2-b28b6fad62d0', None, None, None, None, None)] {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:23:27.393600 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:23:27.394020 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:23:27.394525 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:23:27.394892 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:23:27.395300 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:23:27.404708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:27.405225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:27.405690 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:27.406383 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:27.406832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:27.407285 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:27.424370 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Getting quotas for project 8b93a6978c404ca4aa497919103b5283. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:23:27.428964 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Getting quotas for user c3a65f26ab214feab60c7b6380539076 and project 8b93a6978c404ca4aa497919103b5283. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:23:27.441755 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:23:27.444097 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:23:27.501317 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-69d99e06-3e97-4719-bd56-673f354befd2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.600800 Sep 06 16:23:27.501975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 452/920] 10.222.0.43 () {62 vars in 1188 bytes} [Tue Sep 6 16:23:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 16:23:27.518379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a6e23a9f-4fd8-44f8-b0fb-f5c42081f069 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:27.519106 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a6e23a9f-4fd8-44f8-b0fb-f5c42081f069 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:27.576054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a6e23a9f-4fd8-44f8-b0fb-f5c42081f069 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:27.583767 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a6e23a9f-4fd8-44f8-b0fb-f5c42081f069 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:27.585258 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a6e23a9f-4fd8-44f8-b0fb-f5c42081f069 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:27.586429 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a6e23a9f-4fd8-44f8-b0fb-f5c42081f069 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1281 microversion: 2.20 time: 0.075392 Sep 06 16:23:27.586981 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 469/921] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:27 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:23:28.612108 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-affc3a2f-8534-4772-9478-f7b1310232c7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:28.612802 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-affc3a2f-8534-4772-9478-f7b1310232c7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:28.619946 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-affc3a2f-8534-4772-9478-f7b1310232c7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:28.620434 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-affc3a2f-8534-4772-9478-f7b1310232c7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:28.620913 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-affc3a2f-8534-4772-9478-f7b1310232c7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:28.621620 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-affc3a2f-8534-4772-9478-f7b1310232c7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:28.622074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-affc3a2f-8534-4772-9478-f7b1310232c7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:28.622497 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-affc3a2f-8534-4772-9478-f7b1310232c7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:28.689691 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-affc3a2f-8534-4772-9478-f7b1310232c7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:28.700110 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-affc3a2f-8534-4772-9478-f7b1310232c7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:28.701607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-affc3a2f-8534-4772-9478-f7b1310232c7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:28.702711 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-affc3a2f-8534-4772-9478-f7b1310232c7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1333 microversion: 2.20 time: 0.094915 Sep 06 16:23:28.703266 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 453/922] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:28 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:29.733315 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3e8e787e-8837-43fd-a8e4-569dca7350b3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:29.734292 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3e8e787e-8837-43fd-a8e4-569dca7350b3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:29.742964 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3e8e787e-8837-43fd-a8e4-569dca7350b3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:29.743523 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3e8e787e-8837-43fd-a8e4-569dca7350b3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:29.746307 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3e8e787e-8837-43fd-a8e4-569dca7350b3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:29.746307 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3e8e787e-8837-43fd-a8e4-569dca7350b3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:29.746307 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3e8e787e-8837-43fd-a8e4-569dca7350b3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:29.746307 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3e8e787e-8837-43fd-a8e4-569dca7350b3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:29.896508 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3e8e787e-8837-43fd-a8e4-569dca7350b3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:29.905965 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3e8e787e-8837-43fd-a8e4-569dca7350b3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:29.907754 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3e8e787e-8837-43fd-a8e4-569dca7350b3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:29.908934 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3e8e787e-8837-43fd-a8e4-569dca7350b3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1407 microversion: 2.20 time: 0.181332 Sep 06 16:23:29.909485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 470/923] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:29 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:30.561236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-ed240c9a-b9c9-4ec4-9fc0-db9b7b84b930 req-c421a490-6bc1-45c7-a6d7-b6b1ffc36a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5393a1be-4392-48fb-b317-79525e0639b6", "tag": "871e4881-cbaf-4c42-8c18-28566def207e"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:30.573738 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-ed240c9a-b9c9-4ec4-9fc0-db9b7b84b930 req-c421a490-6bc1-45c7-a6d7-b6b1ffc36a13 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:30.574365 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-ed240c9a-b9c9-4ec4-9fc0-db9b7b84b930 req-c421a490-6bc1-45c7-a6d7-b6b1ffc36a13 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:30.575141 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-ed240c9a-b9c9-4ec4-9fc0-db9b7b84b930 req-c421a490-6bc1-45c7-a6d7-b6b1ffc36a13 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:30.589591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-ed240c9a-b9c9-4ec4-9fc0-db9b7b84b930 req-c421a490-6bc1-45c7-a6d7-b6b1ffc36a13 service nova] Creating event network-changed:871e4881-cbaf-4c42-8c18-28566def207e for instance 5393a1be-4392-48fb-b317-79525e0639b6 on hv-cinder-85221 Sep 06 16:23:30.594975 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-ed240c9a-b9c9-4ec4-9fc0-db9b7b84b930 req-c421a490-6bc1-45c7-a6d7-b6b1ffc36a13 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037949 Sep 06 16:23:30.596269 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 471/924] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:30.605051 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-bf9d5c3f-7235-4394-b6bb-5d9f70b79a9b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-514035415"}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:30.605588 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-bf9d5c3f-7235-4394-b6bb-5d9f70b79a9b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:30.611726 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bf9d5c3f-7235-4394-b6bb-5d9f70b79a9b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:30.612206 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bf9d5c3f-7235-4394-b6bb-5d9f70b79a9b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:30.612635 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bf9d5c3f-7235-4394-b6bb-5d9f70b79a9b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:30.613348 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bf9d5c3f-7235-4394-b6bb-5d9f70b79a9b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:30.613797 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bf9d5c3f-7235-4394-b6bb-5d9f70b79a9b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:30.614246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bf9d5c3f-7235-4394-b6bb-5d9f70b79a9b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:30.936136 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-651d1042-a103-483e-80dd-6dbc255de2ff tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:30.936841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-651d1042-a103-483e-80dd-6dbc255de2ff tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:30.943309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-651d1042-a103-483e-80dd-6dbc255de2ff tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:30.943782 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-651d1042-a103-483e-80dd-6dbc255de2ff tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:30.944213 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-651d1042-a103-483e-80dd-6dbc255de2ff tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:30.944987 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-651d1042-a103-483e-80dd-6dbc255de2ff tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:30.945483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-651d1042-a103-483e-80dd-6dbc255de2ff tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:30.945928 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-651d1042-a103-483e-80dd-6dbc255de2ff tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:30.948388 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.network.security_group_api [None req-bf9d5c3f-7235-4394-b6bb-5d9f70b79a9b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Removing security group 7b70e853-c2dd-49d0-b2b7-e1cdbdf5dfb5 from port c0116dca-9ccf-4f2c-b879-4db2cc4f54a3 Sep 06 16:23:31.102932 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-651d1042-a103-483e-80dd-6dbc255de2ff tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:31.107464 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:31.113990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-651d1042-a103-483e-80dd-6dbc255de2ff tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:31.115635 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-651d1042-a103-483e-80dd-6dbc255de2ff tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:31.116820 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-651d1042-a103-483e-80dd-6dbc255de2ff tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1407 microversion: 2.20 time: 0.185538 Sep 06 16:23:31.117540 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 472/925] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:30 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:31.494776 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-bf9d5c3f-7235-4394-b6bb-5d9f70b79a9b tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "POST /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/action" status: 202 len: 0 microversion: 2.1 time: 1.016092 Sep 06 16:23:31.495452 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 454/926] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:23:30 2022] POST /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/action => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:23:32.142943 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4d337e2c-f7c0-4030-99b7-4545c78dd5d0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:32.143608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4d337e2c-f7c0-4030-99b7-4545c78dd5d0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:32.152166 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d337e2c-f7c0-4030-99b7-4545c78dd5d0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:32.152732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d337e2c-f7c0-4030-99b7-4545c78dd5d0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:32.153165 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d337e2c-f7c0-4030-99b7-4545c78dd5d0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:32.159773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d337e2c-f7c0-4030-99b7-4545c78dd5d0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:32.160442 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d337e2c-f7c0-4030-99b7-4545c78dd5d0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:32.161007 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4d337e2c-f7c0-4030-99b7-4545c78dd5d0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:32.310290 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4d337e2c-f7c0-4030-99b7-4545c78dd5d0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:32.319045 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4d337e2c-f7c0-4030-99b7-4545c78dd5d0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:32.320654 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4d337e2c-f7c0-4030-99b7-4545c78dd5d0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:32.321823 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4d337e2c-f7c0-4030-99b7-4545c78dd5d0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1407 microversion: 2.20 time: 0.183278 Sep 06 16:23:32.322389 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 473/927] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:32 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:23:32.636524 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-c3f7bdd2-6a6d-4e29-8556-3744dba1583c req-ce0e555f-b126-4b31-b7c7-eecc7f2de47b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3078c7e6-28cd-4a26-ba9e-5920ccc1f46a", "tag": "c0116dca-9ccf-4f2c-b879-4db2cc4f54a3"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:32.647478 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-c3f7bdd2-6a6d-4e29-8556-3744dba1583c req-ce0e555f-b126-4b31-b7c7-eecc7f2de47b service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:32.648113 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-c3f7bdd2-6a6d-4e29-8556-3744dba1583c req-ce0e555f-b126-4b31-b7c7-eecc7f2de47b service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:32.648524 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-c3f7bdd2-6a6d-4e29-8556-3744dba1583c req-ce0e555f-b126-4b31-b7c7-eecc7f2de47b service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:32.660934 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-c3f7bdd2-6a6d-4e29-8556-3744dba1583c req-ce0e555f-b126-4b31-b7c7-eecc7f2de47b service nova] Creating event network-changed:c0116dca-9ccf-4f2c-b879-4db2cc4f54a3 for instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a on hv-cinder-85221 Sep 06 16:23:32.666331 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-c3f7bdd2-6a6d-4e29-8556-3744dba1583c req-ce0e555f-b126-4b31-b7c7-eecc7f2de47b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034257 Sep 06 16:23:32.666925 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 455/928] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:32.869124 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f67b1166-69da-4123-bc16-b4ffbe28ac76 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:32.869709 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f67b1166-69da-4123-bc16-b4ffbe28ac76 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:32.876163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f67b1166-69da-4123-bc16-b4ffbe28ac76 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:32.876626 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f67b1166-69da-4123-bc16-b4ffbe28ac76 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:32.877258 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f67b1166-69da-4123-bc16-b4ffbe28ac76 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:32.877956 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f67b1166-69da-4123-bc16-b4ffbe28ac76 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:32.878400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f67b1166-69da-4123-bc16-b4ffbe28ac76 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:32.878970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f67b1166-69da-4123-bc16-b4ffbe28ac76 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:32.968004 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-f67b1166-69da-4123-bc16-b4ffbe28ac76 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lazy-loading 'services' on Instance uuid 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:23:33.048041 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f67b1166-69da-4123-bc16-b4ffbe28ac76 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments/12f0583b-50cd-4e6c-a5ce-55501dec6742" status: 202 len: 0 microversion: 2.1 time: 0.183118 Sep 06 16:23:33.048884 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 474/929] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 6 16:23:32 2022] DELETE /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments/12f0583b-50cd-4e6c-a5ce-55501dec6742 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:23:33.058319 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8e3687f1-9526-426d-b433-83ddc3fdc199 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:33.060682 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8e3687f1-9526-426d-b433-83ddc3fdc199 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:33.069920 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e3687f1-9526-426d-b433-83ddc3fdc199 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:33.070448 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e3687f1-9526-426d-b433-83ddc3fdc199 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:33.070999 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e3687f1-9526-426d-b433-83ddc3fdc199 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:33.071713 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e3687f1-9526-426d-b433-83ddc3fdc199 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:33.072168 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e3687f1-9526-426d-b433-83ddc3fdc199 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:33.072576 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e3687f1-9526-426d-b433-83ddc3fdc199 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:33.118702 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8e3687f1-9526-426d-b433-83ddc3fdc199 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064020 Sep 06 16:23:33.119248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 456/930] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:23:33 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:33.348818 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-29dc8468-f9c3-497e-ac44-f539508ddb8e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:33.349582 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-29dc8468-f9c3-497e-ac44-f539508ddb8e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:33.356435 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29dc8468-f9c3-497e-ac44-f539508ddb8e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:33.356983 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29dc8468-f9c3-497e-ac44-f539508ddb8e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:33.357417 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29dc8468-f9c3-497e-ac44-f539508ddb8e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:33.358117 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29dc8468-f9c3-497e-ac44-f539508ddb8e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:33.358569 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29dc8468-f9c3-497e-ac44-f539508ddb8e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:33.359011 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29dc8468-f9c3-497e-ac44-f539508ddb8e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:33.509564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-29dc8468-f9c3-497e-ac44-f539508ddb8e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:33.519083 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-29dc8468-f9c3-497e-ac44-f539508ddb8e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:33.520509 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-29dc8468-f9c3-497e-ac44-f539508ddb8e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:33.521659 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-29dc8468-f9c3-497e-ac44-f539508ddb8e tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1407 microversion: 2.20 time: 0.178298 Sep 06 16:23:33.522212 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 475/931] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:33 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:34.131738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-85b7f820-01d2-40fd-8493-49d50f0aa546 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:34.134955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-85b7f820-01d2-40fd-8493-49d50f0aa546 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:34.145459 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85b7f820-01d2-40fd-8493-49d50f0aa546 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:34.146327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85b7f820-01d2-40fd-8493-49d50f0aa546 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:34.147247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85b7f820-01d2-40fd-8493-49d50f0aa546 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:34.148733 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85b7f820-01d2-40fd-8493-49d50f0aa546 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:34.149811 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85b7f820-01d2-40fd-8493-49d50f0aa546 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:34.150318 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85b7f820-01d2-40fd-8493-49d50f0aa546 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:34.181950 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-85b7f820-01d2-40fd-8493-49d50f0aa546 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054018 Sep 06 16:23:34.182599 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 457/932] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:23:34 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:34.550822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4fa66e50-6750-483c-960d-7663c9689de6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:34.551597 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4fa66e50-6750-483c-960d-7663c9689de6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:34.554184 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:34.561980 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4fa66e50-6750-483c-960d-7663c9689de6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:34.562464 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4fa66e50-6750-483c-960d-7663c9689de6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:34.562885 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4fa66e50-6750-483c-960d-7663c9689de6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:34.563562 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4fa66e50-6750-483c-960d-7663c9689de6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:34.564028 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4fa66e50-6750-483c-960d-7663c9689de6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:34.564702 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4fa66e50-6750-483c-960d-7663c9689de6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:34.699699 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-41b0e904-10b1-4ae2-bd4b-03027bc2b551 req-5893952c-3f45-495b-9ce7-81e11929263c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3078c7e6-28cd-4a26-ba9e-5920ccc1f46a", "tag": "c0116dca-9ccf-4f2c-b879-4db2cc4f54a3"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:34.703027 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4fa66e50-6750-483c-960d-7663c9689de6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:34.710912 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-41b0e904-10b1-4ae2-bd4b-03027bc2b551 req-5893952c-3f45-495b-9ce7-81e11929263c service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:34.711388 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-41b0e904-10b1-4ae2-bd4b-03027bc2b551 req-5893952c-3f45-495b-9ce7-81e11929263c service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:34.711814 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-41b0e904-10b1-4ae2-bd4b-03027bc2b551 req-5893952c-3f45-495b-9ce7-81e11929263c service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:34.717572 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4fa66e50-6750-483c-960d-7663c9689de6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:34.717572 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4fa66e50-6750-483c-960d-7663c9689de6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:34.718029 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4fa66e50-6750-483c-960d-7663c9689de6 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1407 microversion: 2.20 time: 0.173519 Sep 06 16:23:34.718840 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 476/933] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:34 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:34.726957 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-41b0e904-10b1-4ae2-bd4b-03027bc2b551 req-5893952c-3f45-495b-9ce7-81e11929263c service nova] Creating event network-changed:c0116dca-9ccf-4f2c-b879-4db2cc4f54a3 for instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a on hv-cinder-85221 Sep 06 16:23:34.732581 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-41b0e904-10b1-4ae2-bd4b-03027bc2b551 req-5893952c-3f45-495b-9ce7-81e11929263c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036595 Sep 06 16:23:34.733342 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 458/934] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:23:35.196634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2adce2f3-4b7b-4778-841b-c339fcdd2f1d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:35.199177 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2adce2f3-4b7b-4778-841b-c339fcdd2f1d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:35.206418 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2adce2f3-4b7b-4778-841b-c339fcdd2f1d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:35.207052 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2adce2f3-4b7b-4778-841b-c339fcdd2f1d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:35.207861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2adce2f3-4b7b-4778-841b-c339fcdd2f1d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:35.208823 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2adce2f3-4b7b-4778-841b-c339fcdd2f1d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:35.209463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2adce2f3-4b7b-4778-841b-c339fcdd2f1d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:35.209865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2adce2f3-4b7b-4778-841b-c339fcdd2f1d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:35.242143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2adce2f3-4b7b-4778-841b-c339fcdd2f1d tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049666 Sep 06 16:23:35.243051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 477/935] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:23:35 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:23:35.259153 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ab6942a7-f8ec-483a-ad38-80b9cc3cad68 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:35.259740 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ab6942a7-f8ec-483a-ad38-80b9cc3cad68 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:35.266467 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ab6942a7-f8ec-483a-ad38-80b9cc3cad68 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:35.266944 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ab6942a7-f8ec-483a-ad38-80b9cc3cad68 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:35.267378 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ab6942a7-f8ec-483a-ad38-80b9cc3cad68 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:35.268074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ab6942a7-f8ec-483a-ad38-80b9cc3cad68 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:35.268519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ab6942a7-f8ec-483a-ad38-80b9cc3cad68 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:35.268987 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ab6942a7-f8ec-483a-ad38-80b9cc3cad68 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:35.349361 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-ab6942a7-f8ec-483a-ad38-80b9cc3cad68 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] HTTP exception thrown: Instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a is not attached to volume 12f0583b-50cd-4e6c-a5ce-55501dec6742 Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ab6942a7-f8ec-483a-ad38-80b9cc3cad68 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Request method failure captured: Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: DELETE /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments/12f0583b-50cd-4e6c-a5ce-55501dec6742 HTTP/1.1 Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3KzdQhMbv1hiHYCBLDhHvQvARlFwMXGSxiwqJy4v9cdDvi812PttqDOA_sDOACWJQSlmnWyVx1C1vvrupVihEMW36BGMDVxgVYvOisFFrXup5hJPSzkgx5hhFlHp8ia0zeaUm3S3gIyJtQ4_1926tb4_T9OG8LGf23tLB0TNuxspyQ Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 04bbe101d7ac40ab995da2159f3105cd Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-TestMinimumBasicScenario-1963254531 Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:23:35.356359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:23:35.358203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04bbe101d7ac40ab995da2159f3105cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04bbe101d7ac40ab995da2159f3105cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_04bbe101d7ac40ab995da2159f3105cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/04bbe101d7ac40ab995da2159f3105cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:23:35.358203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-TestMinimumBasicScenario-1963254531 Sep 06 16:23:35.358203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 04bbe101d7ac40ab995da2159f3105cd Sep 06 16:23:35.358203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1963254531 Sep 06 16:23:35.358203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-TestMinimumBasicScenario-1963254531-project Sep 06 16:23:35.358203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:23:35.358203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:23:35.358203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: bbe4c1ecf08f4dd5a005f883c16c6a62 Sep 06 16:23:35.358203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-TestMinimumBasicScenario-1963254531-project Sep 06 16:23:35.358203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:23:35.358203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a is not attached to volume 12f0583b-50cd-4e6c-a5ce-55501dec6742 Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'server_id': '3078c7e6-28cd-4a26-ba9e-5920ccc1f46a', 'id': '12f0583b-50cd-4e6c-a5ce-55501dec6742'} Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 12f0583b-50cd-4e6c-a5ce-55501dec6742. Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:23:35.361202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a is not attached to volume 12f0583b-50cd-4e6c-a5ce-55501dec6742 Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a is not attached to volume 12f0583b-50cd-4e6c-a5ce-55501dec6742 Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:23:35.362547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ab6942a7-f8ec-483a-ad38-80b9cc3cad68 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Returning 404 to user: Instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a is not attached to volume 12f0583b-50cd-4e6c-a5ce-55501dec6742 {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:23:35.363519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ab6942a7-f8ec-483a-ad38-80b9cc3cad68 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments/12f0583b-50cd-4e6c-a5ce-55501dec6742" status: 404 len: 154 microversion: 2.1 time: 0.103900 Sep 06 16:23:35.363519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 459/936] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 6 16:23:35 2022] DELETE /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a/os-volume_attachments/12f0583b-50cd-4e6c-a5ce-55501dec6742 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:23:35.743908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9aa2f5ad-8555-4017-b5ee-167b8994cbfa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:35.745356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9aa2f5ad-8555-4017-b5ee-167b8994cbfa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:35.752705 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9aa2f5ad-8555-4017-b5ee-167b8994cbfa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:35.753562 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9aa2f5ad-8555-4017-b5ee-167b8994cbfa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:35.754042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9aa2f5ad-8555-4017-b5ee-167b8994cbfa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:35.754806 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9aa2f5ad-8555-4017-b5ee-167b8994cbfa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:35.755427 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9aa2f5ad-8555-4017-b5ee-167b8994cbfa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:35.756068 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9aa2f5ad-8555-4017-b5ee-167b8994cbfa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:35.803220 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-14f30422-6dd9-4199-a8c0-a489900f8fa2 req-f3bdfaf9-5cb3-4154-8856-a0f29bd6b6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5393a1be-4392-48fb-b317-79525e0639b6", "name": "network-vif-plugged", "status": "completed", "tag": "871e4881-cbaf-4c42-8c18-28566def207e"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:35.817766 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-14f30422-6dd9-4199-a8c0-a489900f8fa2 req-f3bdfaf9-5cb3-4154-8856-a0f29bd6b6d8 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:35.818507 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-14f30422-6dd9-4199-a8c0-a489900f8fa2 req-f3bdfaf9-5cb3-4154-8856-a0f29bd6b6d8 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:35.819189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-14f30422-6dd9-4199-a8c0-a489900f8fa2 req-f3bdfaf9-5cb3-4154-8856-a0f29bd6b6d8 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:35.836531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-14f30422-6dd9-4199-a8c0-a489900f8fa2 req-f3bdfaf9-5cb3-4154-8856-a0f29bd6b6d8 service nova] Creating event network-vif-plugged:871e4881-cbaf-4c42-8c18-28566def207e for instance 5393a1be-4392-48fb-b317-79525e0639b6 on hv-cinder-85221 Sep 06 16:23:35.844991 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-14f30422-6dd9-4199-a8c0-a489900f8fa2 req-f3bdfaf9-5cb3-4154-8856-a0f29bd6b6d8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045697 Sep 06 16:23:35.847188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 460/937] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:35.922980 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9aa2f5ad-8555-4017-b5ee-167b8994cbfa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:35.933323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9aa2f5ad-8555-4017-b5ee-167b8994cbfa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:35.934767 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9aa2f5ad-8555-4017-b5ee-167b8994cbfa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:35.935889 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9aa2f5ad-8555-4017-b5ee-167b8994cbfa tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1407 microversion: 2.20 time: 0.196465 Sep 06 16:23:35.936461 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 478/938] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:35 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:36.512052 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cb5f9f45-25a8-4137-ae40-096c4b2dc7b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:36.512674 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cb5f9f45-25a8-4137-ae40-096c4b2dc7b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:36.519199 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cb5f9f45-25a8-4137-ae40-096c4b2dc7b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:36.519682 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cb5f9f45-25a8-4137-ae40-096c4b2dc7b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:36.520107 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cb5f9f45-25a8-4137-ae40-096c4b2dc7b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:36.520837 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cb5f9f45-25a8-4137-ae40-096c4b2dc7b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:36.521301 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cb5f9f45-25a8-4137-ae40-096c4b2dc7b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:36.521714 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cb5f9f45-25a8-4137-ae40-096c4b2dc7b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:36.548796 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cb5f9f45-25a8-4137-ae40-096c4b2dc7b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Going to try to terminate instance {{(pid=120669) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:23:36.630440 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cb5f9f45-25a8-4137-ae40-096c4b2dc7b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 204 len: 0 microversion: 2.1 time: 0.122933 Sep 06 16:23:36.631268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 461/939] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:23:36 2022] DELETE /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:23:36.640346 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-316142d8-5851-4805-9198-4f01a119a6b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:36.641072 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-316142d8-5851-4805-9198-4f01a119a6b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:36.647639 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-316142d8-5851-4805-9198-4f01a119a6b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:36.648267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-316142d8-5851-4805-9198-4f01a119a6b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:36.648631 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-316142d8-5851-4805-9198-4f01a119a6b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:36.649364 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-316142d8-5851-4805-9198-4f01a119a6b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:36.649816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-316142d8-5851-4805-9198-4f01a119a6b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:36.650240 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-316142d8-5851-4805-9198-4f01a119a6b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:36.794058 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-316142d8-5851-4805-9198-4f01a119a6b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:36.803645 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-316142d8-5851-4805-9198-4f01a119a6b2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1554 microversion: 2.1 time: 0.167603 Sep 06 16:23:36.804221 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 479/940] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:36 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:36.961815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-582e9efd-7f34-4369-8cf9-2e2099977581 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:36.962506 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-582e9efd-7f34-4369-8cf9-2e2099977581 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:36.964473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:36.970368 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-582e9efd-7f34-4369-8cf9-2e2099977581 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:36.970849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-582e9efd-7f34-4369-8cf9-2e2099977581 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:36.971278 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-582e9efd-7f34-4369-8cf9-2e2099977581 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:36.971975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-582e9efd-7f34-4369-8cf9-2e2099977581 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:36.972418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-582e9efd-7f34-4369-8cf9-2e2099977581 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:36.972888 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-582e9efd-7f34-4369-8cf9-2e2099977581 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:37.110872 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-582e9efd-7f34-4369-8cf9-2e2099977581 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:37.120815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-582e9efd-7f34-4369-8cf9-2e2099977581 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:37.122571 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-582e9efd-7f34-4369-8cf9-2e2099977581 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:37.124256 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-582e9efd-7f34-4369-8cf9-2e2099977581 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1407 microversion: 2.20 time: 0.166755 Sep 06 16:23:37.124950 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 462/941] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:36 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:37.829692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2b92e466-03a1-47cf-b89a-2cdfe61dac87 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:37.830279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2b92e466-03a1-47cf-b89a-2cdfe61dac87 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:37.832542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=6 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:37.838888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b92e466-03a1-47cf-b89a-2cdfe61dac87 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:37.839376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b92e466-03a1-47cf-b89a-2cdfe61dac87 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:37.839782 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b92e466-03a1-47cf-b89a-2cdfe61dac87 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:37.840520 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b92e466-03a1-47cf-b89a-2cdfe61dac87 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:37.840995 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b92e466-03a1-47cf-b89a-2cdfe61dac87 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:37.841413 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2b92e466-03a1-47cf-b89a-2cdfe61dac87 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:37.979043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2b92e466-03a1-47cf-b89a-2cdfe61dac87 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:37.990889 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2b92e466-03a1-47cf-b89a-2cdfe61dac87 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1554 microversion: 2.1 time: 0.165046 Sep 06 16:23:37.991461 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 480/942] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:37 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:38.150663 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c00d9e6c-51ab-450f-a88e-44bea7bb2feb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:38.151240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c00d9e6c-51ab-450f-a88e-44bea7bb2feb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:38.153064 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:38.153723 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=6 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:38.160215 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c00d9e6c-51ab-450f-a88e-44bea7bb2feb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:38.160696 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c00d9e6c-51ab-450f-a88e-44bea7bb2feb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:38.161154 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c00d9e6c-51ab-450f-a88e-44bea7bb2feb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:38.161849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c00d9e6c-51ab-450f-a88e-44bea7bb2feb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:38.162293 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c00d9e6c-51ab-450f-a88e-44bea7bb2feb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:38.162705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c00d9e6c-51ab-450f-a88e-44bea7bb2feb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:38.301731 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c00d9e6c-51ab-450f-a88e-44bea7bb2feb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:38.310855 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c00d9e6c-51ab-450f-a88e-44bea7bb2feb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:38.312286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c00d9e6c-51ab-450f-a88e-44bea7bb2feb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:38.313418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c00d9e6c-51ab-450f-a88e-44bea7bb2feb tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1407 microversion: 2.20 time: 0.166875 Sep 06 16:23:38.313972 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 463/943] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:38 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:39.016777 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4da8d56e-8874-4002-aa09-3b59e8deb371 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:39.017366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4da8d56e-8874-4002-aa09-3b59e8deb371 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:39.024453 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4da8d56e-8874-4002-aa09-3b59e8deb371 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:39.024940 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4da8d56e-8874-4002-aa09-3b59e8deb371 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:39.025429 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4da8d56e-8874-4002-aa09-3b59e8deb371 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:39.026114 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4da8d56e-8874-4002-aa09-3b59e8deb371 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:39.026567 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4da8d56e-8874-4002-aa09-3b59e8deb371 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:39.026990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4da8d56e-8874-4002-aa09-3b59e8deb371 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:39.170405 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4da8d56e-8874-4002-aa09-3b59e8deb371 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:39.180550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4da8d56e-8874-4002-aa09-3b59e8deb371 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1554 microversion: 2.1 time: 0.169268 Sep 06 16:23:39.181145 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 481/944] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:39 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:39.339749 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a520fae3-21ad-446c-879a-cc50fa89d3e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:39.340705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a520fae3-21ad-446c-879a-cc50fa89d3e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:39.348932 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a520fae3-21ad-446c-879a-cc50fa89d3e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:39.349425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a520fae3-21ad-446c-879a-cc50fa89d3e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:39.349851 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a520fae3-21ad-446c-879a-cc50fa89d3e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:39.350551 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a520fae3-21ad-446c-879a-cc50fa89d3e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:39.350995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a520fae3-21ad-446c-879a-cc50fa89d3e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:39.351410 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a520fae3-21ad-446c-879a-cc50fa89d3e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:39.355677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:39.531933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a520fae3-21ad-446c-879a-cc50fa89d3e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:39.544224 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a520fae3-21ad-446c-879a-cc50fa89d3e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:39.545683 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a520fae3-21ad-446c-879a-cc50fa89d3e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:39.547037 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a520fae3-21ad-446c-879a-cc50fa89d3e3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1407 microversion: 2.20 time: 0.211500 Sep 06 16:23:39.547598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 464/945] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:39 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:40.205454 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-44ca181f-4960-49ef-8047-ea67523ab3a2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:40.206167 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-44ca181f-4960-49ef-8047-ea67523ab3a2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:40.213949 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44ca181f-4960-49ef-8047-ea67523ab3a2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:40.214440 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44ca181f-4960-49ef-8047-ea67523ab3a2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:40.214867 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44ca181f-4960-49ef-8047-ea67523ab3a2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:40.215568 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44ca181f-4960-49ef-8047-ea67523ab3a2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:40.216014 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44ca181f-4960-49ef-8047-ea67523ab3a2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:40.216428 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-44ca181f-4960-49ef-8047-ea67523ab3a2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:40.355729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-44ca181f-4960-49ef-8047-ea67523ab3a2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:40.364379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-44ca181f-4960-49ef-8047-ea67523ab3a2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1554 microversion: 2.1 time: 0.162770 Sep 06 16:23:40.365086 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 482/946] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:40 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:40.530739 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-22914666-4db0-4fe7-8194-c98f1cd02232 req-7c432048-b945-47c3-b677-cf0e48780405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3078c7e6-28cd-4a26-ba9e-5920ccc1f46a", "name": "network-vif-deleted", "tag": "c0116dca-9ccf-4f2c-b879-4db2cc4f54a3"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:40.542268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-22914666-4db0-4fe7-8194-c98f1cd02232 req-7c432048-b945-47c3-b677-cf0e48780405 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:40.542788 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-22914666-4db0-4fe7-8194-c98f1cd02232 req-7c432048-b945-47c3-b677-cf0e48780405 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:40.543248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-22914666-4db0-4fe7-8194-c98f1cd02232 req-7c432048-b945-47c3-b677-cf0e48780405 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:40.555960 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-22914666-4db0-4fe7-8194-c98f1cd02232 req-7c432048-b945-47c3-b677-cf0e48780405 service nova] Creating event network-vif-deleted:c0116dca-9ccf-4f2c-b879-4db2cc4f54a3 for instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a on hv-cinder-85221 Sep 06 16:23:40.561338 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-22914666-4db0-4fe7-8194-c98f1cd02232 req-7c432048-b945-47c3-b677-cf0e48780405 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034228 Sep 06 16:23:40.561903 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 465/947] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:23:40.574529 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-10fa8b8b-7acc-42ba-904a-9c0671d5d7de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:40.575238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-10fa8b8b-7acc-42ba-904a-9c0671d5d7de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:40.581700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10fa8b8b-7acc-42ba-904a-9c0671d5d7de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:40.582210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10fa8b8b-7acc-42ba-904a-9c0671d5d7de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:40.582546 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10fa8b8b-7acc-42ba-904a-9c0671d5d7de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:40.583233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10fa8b8b-7acc-42ba-904a-9c0671d5d7de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:40.583676 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10fa8b8b-7acc-42ba-904a-9c0671d5d7de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:40.584090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10fa8b8b-7acc-42ba-904a-9c0671d5d7de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:40.729693 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-10fa8b8b-7acc-42ba-904a-9c0671d5d7de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:40.738252 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-10fa8b8b-7acc-42ba-904a-9c0671d5d7de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:40.739623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-10fa8b8b-7acc-42ba-904a-9c0671d5d7de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:40.740933 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-10fa8b8b-7acc-42ba-904a-9c0671d5d7de tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1599 microversion: 2.20 time: 0.172726 Sep 06 16:23:40.741653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 483/948] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:23:40 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:23:40.766686 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f3b919d9-7502-4213-989a-c7579f2b4290 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:40.767274 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f3b919d9-7502-4213-989a-c7579f2b4290 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:40.773600 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f3b919d9-7502-4213-989a-c7579f2b4290 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:40.776089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f3b919d9-7502-4213-989a-c7579f2b4290 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:40.776089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f3b919d9-7502-4213-989a-c7579f2b4290 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:40.776089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f3b919d9-7502-4213-989a-c7579f2b4290 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:40.776387 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f3b919d9-7502-4213-989a-c7579f2b4290 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:40.776803 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f3b919d9-7502-4213-989a-c7579f2b4290 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:40.868683 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f3b919d9-7502-4213-989a-c7579f2b4290 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106579 Sep 06 16:23:40.869591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 466/949] 10.222.0.43 () {60 vars in 1316 bytes} [Tue Sep 6 16:23:40 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:23:41.389579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:41.390877 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:41.397561 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:41.398459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:41.398777 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:41.399528 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:41.399941 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:41.400534 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:41.441303 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:41.441798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:41.442228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:41.442665 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lazy-loading 'fault' on Instance uuid 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:23:41.493686 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe4c1ecf08f4dd5a005f883c16c6a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bbe101d7ac40ab995da2159f3105cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:41.500979 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-554ef5f3-5be8-4dae-85e0-5b4948ab159e tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 200 len: 1348 microversion: 2.1 time: 0.115209 Sep 06 16:23:41.501663 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 484/950] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:41 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 1348 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:23:42.525249 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-79549977-6b5a-431a-99d2-6bc9ff1d36f2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:42.525877 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-79549977-6b5a-431a-99d2-6bc9ff1d36f2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] [instance: 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:42.532500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-79549977-6b5a-431a-99d2-6bc9ff1d36f2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:42.532935 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-79549977-6b5a-431a-99d2-6bc9ff1d36f2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:42.533363 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-79549977-6b5a-431a-99d2-6bc9ff1d36f2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:42.534070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-79549977-6b5a-431a-99d2-6bc9ff1d36f2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:42.534515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-79549977-6b5a-431a-99d2-6bc9ff1d36f2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:42.534929 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-79549977-6b5a-431a-99d2-6bc9ff1d36f2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:42.549356 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-79549977-6b5a-431a-99d2-6bc9ff1d36f2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] HTTP exception thrown: Instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a could not be found. Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-79549977-6b5a-431a-99d2-6bc9ff1d36f2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Request method failure captured: Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a HTTP/1.1 Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3KzdQhMbv1hiHYCBLDhHvQvARlFwMXGSxiwqJy4v9cdDvi812PttqDOA_sDOACWJQSlmnWyVx1C1vvrupVihEMW36BGMDVxgVYvOisFFrXup5hJPSzkgx5hhFlHp8ia0zeaUm3S3gIyJtQ4_1926tb4_T9OG8LGf23tLB0TNuxspyQ Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 04bbe101d7ac40ab995da2159f3105cd Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-TestMinimumBasicScenario-1963254531 Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:23:42.551027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:23:42.552574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04bbe101d7ac40ab995da2159f3105cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04bbe101d7ac40ab995da2159f3105cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_04bbe101d7ac40ab995da2159f3105cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/04bbe101d7ac40ab995da2159f3105cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:23:42.552574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-TestMinimumBasicScenario-1963254531 Sep 06 16:23:42.552574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 04bbe101d7ac40ab995da2159f3105cd Sep 06 16:23:42.552574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1963254531 Sep 06 16:23:42.552574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-TestMinimumBasicScenario-1963254531-project Sep 06 16:23:42.552574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:23:42.552574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:23:42.552574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: bbe4c1ecf08f4dd5a005f883c16c6a62 Sep 06 16:23:42.552574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-TestMinimumBasicScenario-1963254531-project Sep 06 16:23:42.552574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:23:42.552574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a could not be found. Sep 06 16:23:42.552574 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': '3078c7e6-28cd-4a26-ba9e-5920ccc1f46a'} Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a could not be found. Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:23:42.553535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a could not be found. Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a could not be found. Sep 06 16:23:42.555414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:23:42.557247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-79549977-6b5a-431a-99d2-6bc9ff1d36f2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Returning 404 to user: Instance 3078c7e6-28cd-4a26-ba9e-5920ccc1f46a could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:23:42.557247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-79549977-6b5a-431a-99d2-6bc9ff1d36f2 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a" status: 404 len: 111 microversion: 2.1 time: 0.032009 Sep 06 16:23:42.557247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 467/951] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:42 2022] GET /compute/v2.1/servers/3078c7e6-28cd-4a26-ba9e-5920ccc1f46a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:23:42.562601 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2fac921c-9aa3-4d3d-81e8-a7c533bc8cf5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] Calling method '.version_select at 0x7f83e942ac10>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:42.579662 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-63bea7eb-c0c8-4d35-bd41-cbc98fa3ec10 req-cf7be2ed-5559-4b57-b250-2c2fd0a5780b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5393a1be-4392-48fb-b317-79525e0639b6", "tag": "871e4881-cbaf-4c42-8c18-28566def207e"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:42.586962 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2fac921c-9aa3-4d3d-81e8-a7c533bc8cf5 tempest-TestMinimumBasicScenario-1963254531 tempest-TestMinimumBasicScenario-1963254531-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-651954085" status: 202 len: 0 microversion: 2.1 time: 0.027513 Sep 06 16:23:42.589433 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 485/952] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Sep 6 16:23:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-651954085 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:23:42.591148 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-63bea7eb-c0c8-4d35-bd41-cbc98fa3ec10 req-cf7be2ed-5559-4b57-b250-2c2fd0a5780b service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:42.591633 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-63bea7eb-c0c8-4d35-bd41-cbc98fa3ec10 req-cf7be2ed-5559-4b57-b250-2c2fd0a5780b service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:42.592051 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-63bea7eb-c0c8-4d35-bd41-cbc98fa3ec10 req-cf7be2ed-5559-4b57-b250-2c2fd0a5780b service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:42.604601 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-63bea7eb-c0c8-4d35-bd41-cbc98fa3ec10 req-cf7be2ed-5559-4b57-b250-2c2fd0a5780b service nova] Creating event network-changed:871e4881-cbaf-4c42-8c18-28566def207e for instance 5393a1be-4392-48fb-b317-79525e0639b6 on hv-cinder-85221 Sep 06 16:23:42.609657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-63bea7eb-c0c8-4d35-bd41-cbc98fa3ec10 req-cf7be2ed-5559-4b57-b250-2c2fd0a5780b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034504 Sep 06 16:23:42.610590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 468/953] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:01.753891 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:01.755916 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:01.963222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-337251aa-80ea-4f95-80bb-48a2f3c9a0c0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Action: 'create', calling method: .version_select at 0x7f83e93dae50>, body: {"keypair": {"name": "tempest-TestShelveInstance-437123889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkbz3A5oPY3cSLUlquMW36kPxiYOXskIvofEvN4bUc7tmVwYp7EEhF+waoufCB7+pfzvULkpKbUderlI90xgrT7rP+JkJtrtfvvg7B1Gqfyj/BHNUVWQT49t7U/AB8viQ=="}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:01.979154 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-337251aa-80ea-4f95-80bb-48a2f3c9a0c0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Getting quotas for project 71b0e99f20e842c29ec46e5731ae9d9a. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:24:01.983395 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-337251aa-80ea-4f95-80bb-48a2f3c9a0c0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Getting quotas for user e8bab2b0d23a47e19c4a50e72fc75714 and project 71b0e99f20e842c29ec46e5731ae9d9a. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:24:02.007103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-337251aa-80ea-4f95-80bb-48a2f3c9a0c0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.258400 Sep 06 16:24:02.007715 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 486/954] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 6 16:24:01 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:26.858887 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=13 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:26.859619 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=14 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:26.864023 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1649211940", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-437123889", "security_groups": [{"name": "tempest-secgroup-smoke-414885228"}], "networks": [{"uuid": "693c1649-d068-4733-a64a-cab85c2e3362"}], "block_device_mapping_v2": [{"uuid": "3297a45a-dfac-4cdc-8d62-9540fc85b4f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:26.990486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] validate_networks() for [('693c1649-d068-4733-a64a-cab85c2e3362', None, None, None, None, None)] {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:24:27.405557 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:24:27.406450 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:24:27.406450 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:24:27.406919 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:24:27.407432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:24:27.417542 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:27.418053 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:27.418482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:27.419244 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:27.419718 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:27.420142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:27.440291 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Getting quotas for project 71b0e99f20e842c29ec46e5731ae9d9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:24:27.444339 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Getting quotas for user e8bab2b0d23a47e19c4a50e72fc75714 and project 71b0e99f20e842c29ec46e5731ae9d9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:24:27.500692 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:24:27.502928 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3297a45a-dfac-4cdc-8d62-9540fc85b4f1',volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:24:27.644831 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-851b37c5-9855-45c3-bab2-f200e2a7e3af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.787814 Sep 06 16:24:27.645499 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 469/955] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:24:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:24:27.657222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ef86dedd-f43a-41ce-a652-00fe2c54a096 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:27.657752 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ef86dedd-f43a-41ce-a652-00fe2c54a096 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:27.659863 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=4 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:27.660498 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:27.714574 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ef86dedd-f43a-41ce-a652-00fe2c54a096 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:27.721618 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ef86dedd-f43a-41ce-a652-00fe2c54a096 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1088 microversion: 2.1 time: 0.068555 Sep 06 16:24:27.722330 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 487/956] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:27 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:28.809966 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-70f62cf5-cd5b-4e7d-afe3-1e25e78b931d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:28.810560 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-70f62cf5-cd5b-4e7d-afe3-1e25e78b931d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:28.818316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-70f62cf5-cd5b-4e7d-afe3-1e25e78b931d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:28.818800 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-70f62cf5-cd5b-4e7d-afe3-1e25e78b931d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:28.819230 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-70f62cf5-cd5b-4e7d-afe3-1e25e78b931d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:28.819934 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-70f62cf5-cd5b-4e7d-afe3-1e25e78b931d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:28.820421 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-70f62cf5-cd5b-4e7d-afe3-1e25e78b931d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:28.820874 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-70f62cf5-cd5b-4e7d-afe3-1e25e78b931d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:28.891675 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-70f62cf5-cd5b-4e7d-afe3-1e25e78b931d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:28.900454 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-70f62cf5-cd5b-4e7d-afe3-1e25e78b931d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1186 microversion: 2.1 time: 0.097527 Sep 06 16:24:28.901246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 470/957] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:28 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1186 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:29.924657 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-cd3d4dbe-a01b-4cad-a63a-82f71eb1c704 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:29.924657 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-cd3d4dbe-a01b-4cad-a63a-82f71eb1c704 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:29.933713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cd3d4dbe-a01b-4cad-a63a-82f71eb1c704 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:29.934227 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cd3d4dbe-a01b-4cad-a63a-82f71eb1c704 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:29.934657 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cd3d4dbe-a01b-4cad-a63a-82f71eb1c704 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:29.935376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cd3d4dbe-a01b-4cad-a63a-82f71eb1c704 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:29.935840 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cd3d4dbe-a01b-4cad-a63a-82f71eb1c704 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:29.936418 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cd3d4dbe-a01b-4cad-a63a-82f71eb1c704 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:30.003573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cd3d4dbe-a01b-4cad-a63a-82f71eb1c704 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:30.011479 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-cd3d4dbe-a01b-4cad-a63a-82f71eb1c704 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1204 microversion: 2.1 time: 0.091580 Sep 06 16:24:30.012077 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 488/958] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:29 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:30.867046 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-666a684d-5cf7-4b17-aeab-bd9223bfe8aa req-1591b734-9820-435b-b621-14ae138413d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993ac4a3-a4e1-43cb-b6da-af83833f1396", "tag": "b8387b10-ca79-44d9-bb60-26753cfeeac9"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:30.877988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-666a684d-5cf7-4b17-aeab-bd9223bfe8aa req-1591b734-9820-435b-b621-14ae138413d0 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:30.878592 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-666a684d-5cf7-4b17-aeab-bd9223bfe8aa req-1591b734-9820-435b-b621-14ae138413d0 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:30.879098 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-666a684d-5cf7-4b17-aeab-bd9223bfe8aa req-1591b734-9820-435b-b621-14ae138413d0 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:30.891528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-666a684d-5cf7-4b17-aeab-bd9223bfe8aa req-1591b734-9820-435b-b621-14ae138413d0 service nova] Creating event network-changed:b8387b10-ca79-44d9-bb60-26753cfeeac9 for instance 993ac4a3-a4e1-43cb-b6da-af83833f1396 on hv-cinder-85221 Sep 06 16:24:30.897477 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-666a684d-5cf7-4b17-aeab-bd9223bfe8aa req-1591b734-9820-435b-b621-14ae138413d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034114 Sep 06 16:24:30.898088 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 471/959] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:31.036372 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f172ece1-b446-448a-bcb1-607b40417562 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:31.037204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f172ece1-b446-448a-bcb1-607b40417562 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:31.043428 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f172ece1-b446-448a-bcb1-607b40417562 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:31.043914 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f172ece1-b446-448a-bcb1-607b40417562 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:31.044341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f172ece1-b446-448a-bcb1-607b40417562 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:31.045080 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f172ece1-b446-448a-bcb1-607b40417562 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:31.045532 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f172ece1-b446-448a-bcb1-607b40417562 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:31.045948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f172ece1-b446-448a-bcb1-607b40417562 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:31.182170 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f172ece1-b446-448a-bcb1-607b40417562 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:31.190116 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f172ece1-b446-448a-bcb1-607b40417562 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1259 microversion: 2.1 time: 0.158430 Sep 06 16:24:31.190684 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 489/960] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:31 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:32.214987 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-58fdea07-b907-4f50-a2f8-40da2486b315 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:32.215710 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-58fdea07-b907-4f50-a2f8-40da2486b315 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:32.222540 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-58fdea07-b907-4f50-a2f8-40da2486b315 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:32.223037 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-58fdea07-b907-4f50-a2f8-40da2486b315 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:32.223443 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-58fdea07-b907-4f50-a2f8-40da2486b315 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:32.224155 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-58fdea07-b907-4f50-a2f8-40da2486b315 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:32.224603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-58fdea07-b907-4f50-a2f8-40da2486b315 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:32.225050 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-58fdea07-b907-4f50-a2f8-40da2486b315 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:32.360455 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-58fdea07-b907-4f50-a2f8-40da2486b315 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:32.371034 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-58fdea07-b907-4f50-a2f8-40da2486b315 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1259 microversion: 2.1 time: 0.160471 Sep 06 16:24:32.372082 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 472/961] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:32 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:33.394893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-89de3da9-7b3c-406d-ad22-c7be179dcf04 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:33.395602 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-89de3da9-7b3c-406d-ad22-c7be179dcf04 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:33.402503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89de3da9-7b3c-406d-ad22-c7be179dcf04 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:33.402988 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89de3da9-7b3c-406d-ad22-c7be179dcf04 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:33.403416 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89de3da9-7b3c-406d-ad22-c7be179dcf04 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:33.404123 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89de3da9-7b3c-406d-ad22-c7be179dcf04 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:33.404546 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89de3da9-7b3c-406d-ad22-c7be179dcf04 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:33.405012 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-89de3da9-7b3c-406d-ad22-c7be179dcf04 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:33.544244 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-89de3da9-7b3c-406d-ad22-c7be179dcf04 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:33.554343 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-89de3da9-7b3c-406d-ad22-c7be179dcf04 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1259 microversion: 2.1 time: 0.162952 Sep 06 16:24:33.554953 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 490/962] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:33 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:24:33.747564 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b54a6c04-bf34-422c-9806-112d7fc4b7f2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:33.749818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b54a6c04-bf34-422c-9806-112d7fc4b7f2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:33.756543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b54a6c04-bf34-422c-9806-112d7fc4b7f2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:33.757060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b54a6c04-bf34-422c-9806-112d7fc4b7f2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:33.757494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b54a6c04-bf34-422c-9806-112d7fc4b7f2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:33.758176 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b54a6c04-bf34-422c-9806-112d7fc4b7f2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:33.758622 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b54a6c04-bf34-422c-9806-112d7fc4b7f2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:33.759040 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b54a6c04-bf34-422c-9806-112d7fc4b7f2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:33.787647 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b54a6c04-bf34-422c-9806-112d7fc4b7f2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044096 Sep 06 16:24:33.788195 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 473/963] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:24:33 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:24:33.859648 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d561fc47-df81-4921-ba61-7da1939df552 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:33.860110 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d561fc47-df81-4921-ba61-7da1939df552 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:33.866438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d561fc47-df81-4921-ba61-7da1939df552 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:33.866947 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d561fc47-df81-4921-ba61-7da1939df552 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:33.867374 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d561fc47-df81-4921-ba61-7da1939df552 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:33.868066 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d561fc47-df81-4921-ba61-7da1939df552 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:33.868514 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d561fc47-df81-4921-ba61-7da1939df552 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:33.868969 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d561fc47-df81-4921-ba61-7da1939df552 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:33.894401 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d561fc47-df81-4921-ba61-7da1939df552 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Going to try to terminate instance {{(pid=120668) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:24:33.971136 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d561fc47-df81-4921-ba61-7da1939df552 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 204 len: 0 microversion: 2.1 time: 0.115087 Sep 06 16:24:33.971712 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 491/964] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:24:33 2022] DELETE /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:24:33.979925 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d191a857-d9ed-4a42-a620-a4ea05c80dd1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:33.980540 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d191a857-d9ed-4a42-a620-a4ea05c80dd1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:33.986589 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d191a857-d9ed-4a42-a620-a4ea05c80dd1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:33.987064 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d191a857-d9ed-4a42-a620-a4ea05c80dd1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:33.987495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d191a857-d9ed-4a42-a620-a4ea05c80dd1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:33.988177 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d191a857-d9ed-4a42-a620-a4ea05c80dd1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:33.988629 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d191a857-d9ed-4a42-a620-a4ea05c80dd1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:33.989067 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d191a857-d9ed-4a42-a620-a4ea05c80dd1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:34.124103 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d191a857-d9ed-4a42-a620-a4ea05c80dd1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:34.132581 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d191a857-d9ed-4a42-a620-a4ea05c80dd1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1675 microversion: 2.1 time: 0.156451 Sep 06 16:24:34.133190 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 474/965] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:33 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:34.581641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7110d66e-0935-4ea7-a824-0d7c0d7ca0c7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:34.582405 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7110d66e-0935-4ea7-a824-0d7c0d7ca0c7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:34.589398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7110d66e-0935-4ea7-a824-0d7c0d7ca0c7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:34.589883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7110d66e-0935-4ea7-a824-0d7c0d7ca0c7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:34.590323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7110d66e-0935-4ea7-a824-0d7c0d7ca0c7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:34.591009 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7110d66e-0935-4ea7-a824-0d7c0d7ca0c7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:34.591459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7110d66e-0935-4ea7-a824-0d7c0d7ca0c7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:34.591882 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7110d66e-0935-4ea7-a824-0d7c0d7ca0c7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:34.736730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7110d66e-0935-4ea7-a824-0d7c0d7ca0c7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:34.748369 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7110d66e-0935-4ea7-a824-0d7c0d7ca0c7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1259 microversion: 2.1 time: 0.172471 Sep 06 16:24:34.749115 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 492/966] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:34 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:35.167885 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-57f9f3f4-de7e-4cc2-b458-fac0a1ec25ca tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:35.168513 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-57f9f3f4-de7e-4cc2-b458-fac0a1ec25ca tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:35.176024 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57f9f3f4-de7e-4cc2-b458-fac0a1ec25ca tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:35.176503 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57f9f3f4-de7e-4cc2-b458-fac0a1ec25ca tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:35.176970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57f9f3f4-de7e-4cc2-b458-fac0a1ec25ca tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:35.177637 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57f9f3f4-de7e-4cc2-b458-fac0a1ec25ca tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:35.178083 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57f9f3f4-de7e-4cc2-b458-fac0a1ec25ca tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:35.178502 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57f9f3f4-de7e-4cc2-b458-fac0a1ec25ca tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:35.320602 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-57f9f3f4-de7e-4cc2-b458-fac0a1ec25ca tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:35.328784 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-57f9f3f4-de7e-4cc2-b458-fac0a1ec25ca tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1675 microversion: 2.1 time: 0.167320 Sep 06 16:24:35.329361 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 475/967] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:35 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:35.776582 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-36a2e5b5-3ba5-4888-b2c2-68bd9b4512ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:35.777599 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-36a2e5b5-3ba5-4888-b2c2-68bd9b4512ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:35.785949 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-36a2e5b5-3ba5-4888-b2c2-68bd9b4512ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:35.786352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-36a2e5b5-3ba5-4888-b2c2-68bd9b4512ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:35.786785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-36a2e5b5-3ba5-4888-b2c2-68bd9b4512ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:35.787470 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-36a2e5b5-3ba5-4888-b2c2-68bd9b4512ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:35.787918 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-36a2e5b5-3ba5-4888-b2c2-68bd9b4512ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:35.788341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-36a2e5b5-3ba5-4888-b2c2-68bd9b4512ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:35.921074 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-36a2e5b5-3ba5-4888-b2c2-68bd9b4512ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:35.929672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-36a2e5b5-3ba5-4888-b2c2-68bd9b4512ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1259 microversion: 2.1 time: 0.159708 Sep 06 16:24:35.930246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 493/968] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:35 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:36.351757 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cce9c61e-613a-4a34-bf5a-51b09bf9662e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:36.352351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cce9c61e-613a-4a34-bf5a-51b09bf9662e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:36.359134 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cce9c61e-613a-4a34-bf5a-51b09bf9662e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:36.359618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cce9c61e-613a-4a34-bf5a-51b09bf9662e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:36.360035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cce9c61e-613a-4a34-bf5a-51b09bf9662e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:36.360746 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cce9c61e-613a-4a34-bf5a-51b09bf9662e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:36.361217 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cce9c61e-613a-4a34-bf5a-51b09bf9662e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:36.361610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cce9c61e-613a-4a34-bf5a-51b09bf9662e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:36.596909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cce9c61e-613a-4a34-bf5a-51b09bf9662e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:36.606039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cce9c61e-613a-4a34-bf5a-51b09bf9662e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1675 microversion: 2.1 time: 0.258234 Sep 06 16:24:36.606862 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 476/969] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:36 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1675 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:36.751030 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a7e9e813-58b2-4db3-8ed6-e44fb31c4c91 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:36.751501 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a7e9e813-58b2-4db3-8ed6-e44fb31c4c91 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:36.757607 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7e9e813-58b2-4db3-8ed6-e44fb31c4c91 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:36.758093 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7e9e813-58b2-4db3-8ed6-e44fb31c4c91 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:36.758507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7e9e813-58b2-4db3-8ed6-e44fb31c4c91 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:36.759416 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7e9e813-58b2-4db3-8ed6-e44fb31c4c91 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:36.759870 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7e9e813-58b2-4db3-8ed6-e44fb31c4c91 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:36.760293 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a7e9e813-58b2-4db3-8ed6-e44fb31c4c91 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:36.844017 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-a7e9e813-58b2-4db3-8ed6-e44fb31c4c91 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lazy-loading 'services' on Instance uuid c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:24:36.921561 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a7e9e813-58b2-4db3-8ed6-e44fb31c4c91 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments/4a487c6e-4910-4bd8-868b-f99da22e97f4" status: 202 len: 0 microversion: 2.1 time: 0.174384 Sep 06 16:24:36.922209 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 494/970] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 6 16:24:36 2022] DELETE /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments/4a487c6e-4910-4bd8-868b-f99da22e97f4 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 16:24:36.930993 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0b259254-afdc-4fb8-a28a-679bdc9ef3fd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:36.933481 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0b259254-afdc-4fb8-a28a-679bdc9ef3fd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:36.940039 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b259254-afdc-4fb8-a28a-679bdc9ef3fd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:36.940744 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b259254-afdc-4fb8-a28a-679bdc9ef3fd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:36.941353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b259254-afdc-4fb8-a28a-679bdc9ef3fd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:36.942248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b259254-afdc-4fb8-a28a-679bdc9ef3fd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:36.942937 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b259254-afdc-4fb8-a28a-679bdc9ef3fd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:36.943533 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b259254-afdc-4fb8-a28a-679bdc9ef3fd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:36.954250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b6d435a7-27be-40d2-9326-17e5e9cf822d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:36.955613 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b6d435a7-27be-40d2-9326-17e5e9cf822d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:36.964028 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b6d435a7-27be-40d2-9326-17e5e9cf822d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:36.964913 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b6d435a7-27be-40d2-9326-17e5e9cf822d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:36.965776 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b6d435a7-27be-40d2-9326-17e5e9cf822d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:36.967244 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b6d435a7-27be-40d2-9326-17e5e9cf822d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:36.967919 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b6d435a7-27be-40d2-9326-17e5e9cf822d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:36.968344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b6d435a7-27be-40d2-9326-17e5e9cf822d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:36.982896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0b259254-afdc-4fb8-a28a-679bdc9ef3fd tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056049 Sep 06 16:24:36.988418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 477/971] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:24:36 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:37.026661 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-f42658ac-8591-490d-8ab2-965e3995af0b req-dcbc7391-1382-4144-a23b-3d50d2527f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc140df-902e-4875-822f-53831e91b1c3", "name": "network-vif-deleted", "tag": "42ae6570-50c2-4446-95be-d0b723ac181e"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:37.036955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-f42658ac-8591-490d-8ab2-965e3995af0b req-dcbc7391-1382-4144-a23b-3d50d2527f63 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:37.037706 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-f42658ac-8591-490d-8ab2-965e3995af0b req-dcbc7391-1382-4144-a23b-3d50d2527f63 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:37.038512 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-f42658ac-8591-490d-8ab2-965e3995af0b req-dcbc7391-1382-4144-a23b-3d50d2527f63 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:37.055184 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-f42658ac-8591-490d-8ab2-965e3995af0b req-dcbc7391-1382-4144-a23b-3d50d2527f63 service nova] Creating event network-vif-deleted:42ae6570-50c2-4446-95be-d0b723ac181e for instance dbc140df-902e-4875-822f-53831e91b1c3 on hv-cinder-85221 Sep 06 16:24:37.064690 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-f42658ac-8591-490d-8ab2-965e3995af0b req-dcbc7391-1382-4144-a23b-3d50d2527f63 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038924 Sep 06 16:24:37.069110 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 478/972] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:24:37.169178 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b6d435a7-27be-40d2-9326-17e5e9cf822d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:37.177906 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b6d435a7-27be-40d2-9326-17e5e9cf822d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1259 microversion: 2.1 time: 0.228804 Sep 06 16:24:37.178970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 495/973] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:36 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:37.631888 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:37.633527 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:37.637124 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:37.637759 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=6 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:37.643245 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:37.643996 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:37.644459 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:37.645256 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:37.645805 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:37.646175 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:37.681774 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:37.682251 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:37.682814 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:37.683274 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lazy-loading 'fault' on Instance uuid dbc140df-902e-4875-822f-53831e91b1c3 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:24:37.730737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:37.738743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e581b9ba-8d8b-4f49-a9d6-1aa0ec71840d tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 200 len: 1327 microversion: 2.1 time: 0.111254 Sep 06 16:24:37.739353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 479/974] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:37 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:37.996248 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d4ea6caf-ce77-4250-95e5-c6580f6625db tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:37.998381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d4ea6caf-ce77-4250-95e5-c6580f6625db tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:38.003865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:38.006120 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4ea6caf-ce77-4250-95e5-c6580f6625db tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:38.006609 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4ea6caf-ce77-4250-95e5-c6580f6625db tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:38.007084 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4ea6caf-ce77-4250-95e5-c6580f6625db tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:38.007782 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4ea6caf-ce77-4250-95e5-c6580f6625db tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:38.008231 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4ea6caf-ce77-4250-95e5-c6580f6625db tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:38.008650 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d4ea6caf-ce77-4250-95e5-c6580f6625db tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:38.048024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d4ea6caf-ce77-4250-95e5-c6580f6625db tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056163 Sep 06 16:24:38.049309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 496/975] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:24:37 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:38.202732 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-38582451-7b10-4e1c-8544-77788d55e659 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:38.203530 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-38582451-7b10-4e1c-8544-77788d55e659 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:38.210140 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38582451-7b10-4e1c-8544-77788d55e659 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:38.210631 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38582451-7b10-4e1c-8544-77788d55e659 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:38.211064 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38582451-7b10-4e1c-8544-77788d55e659 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:38.211748 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38582451-7b10-4e1c-8544-77788d55e659 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:38.212930 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38582451-7b10-4e1c-8544-77788d55e659 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:38.212930 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-38582451-7b10-4e1c-8544-77788d55e659 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:38.371400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-1da57c81-72f5-449b-ae6b-676aa7b46d7a req-0aac9168-b8fc-4283-8217-18281d899416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993ac4a3-a4e1-43cb-b6da-af83833f1396", "name": "network-vif-plugged", "status": "completed", "tag": "b8387b10-ca79-44d9-bb60-26753cfeeac9"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:38.390396 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-1da57c81-72f5-449b-ae6b-676aa7b46d7a req-0aac9168-b8fc-4283-8217-18281d899416 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:38.390872 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-1da57c81-72f5-449b-ae6b-676aa7b46d7a req-0aac9168-b8fc-4283-8217-18281d899416 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:38.395553 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-1da57c81-72f5-449b-ae6b-676aa7b46d7a req-0aac9168-b8fc-4283-8217-18281d899416 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:38.424879 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-1da57c81-72f5-449b-ae6b-676aa7b46d7a req-0aac9168-b8fc-4283-8217-18281d899416 service nova] Creating event network-vif-plugged:b8387b10-ca79-44d9-bb60-26753cfeeac9 for instance 993ac4a3-a4e1-43cb-b6da-af83833f1396 on hv-cinder-85221 Sep 06 16:24:38.431501 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-1da57c81-72f5-449b-ae6b-676aa7b46d7a req-0aac9168-b8fc-4283-8217-18281d899416 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063828 Sep 06 16:24:38.432533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 497/976] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:38.439694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-38582451-7b10-4e1c-8544-77788d55e659 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:38.447817 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-38582451-7b10-4e1c-8544-77788d55e659 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1259 microversion: 2.1 time: 0.249172 Sep 06 16:24:38.448397 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 480/977] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:38 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:38.762613 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6acbf042-d007-4a86-9513-f5db35d80444 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:38.763396 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6acbf042-d007-4a86-9513-f5db35d80444 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:38.769968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6acbf042-d007-4a86-9513-f5db35d80444 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:38.770456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6acbf042-d007-4a86-9513-f5db35d80444 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:38.770885 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6acbf042-d007-4a86-9513-f5db35d80444 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:38.771566 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6acbf042-d007-4a86-9513-f5db35d80444 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:38.772016 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6acbf042-d007-4a86-9513-f5db35d80444 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:38.772489 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6acbf042-d007-4a86-9513-f5db35d80444 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:38.786330 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-6acbf042-d007-4a86-9513-f5db35d80444 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] HTTP exception thrown: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6acbf042-d007-4a86-9513-f5db35d80444 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Request method failure captured: Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 HTTP/1.1 Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3I7XZAP2rEccRH17orHIdnfGI8mYnSWwhrkcF5L1jIXCtcR_IaNpMNh5npnj8_7Z-b3weCNmmzz3eWc0RpjJ9AUHU9C3oeZy3sGVHsmGEXrDIuh6njoiHyk2a0tU4QTXOebrg73HxMMtpON7bgVW_kGjMHlGIn8ODmFx-sseZ3p_kw Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: ad0bef00a05c4029a009992a7f96fa80 Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:24:38.788024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:24:38.789731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:24:38.789731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:24:38.789731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: ad0bef00a05c4029a009992a7f96fa80 Sep 06 16:24:38.789731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:24:38.789731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeTestJSON-1420528339-project Sep 06 16:24:38.789731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:24:38.789731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:24:38.789731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: e225aec64aee47449542aecbec0ae561 Sep 06 16:24:38.789731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeTestJSON-1420528339-project Sep 06 16:24:38.789731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:24:38.789731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:24:38.789731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'dbc140df-902e-4875-822f-53831e91b1c3'} Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:24:38.790672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:24:38.792155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:38.793723 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6acbf042-d007-4a86-9513-f5db35d80444 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Returning 404 to user: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:24:38.793723 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6acbf042-d007-4a86-9513-f5db35d80444 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 404 len: 111 microversion: 2.1 time: 0.031218 Sep 06 16:24:38.793723 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 498/978] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:38 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:24:38.802724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-bea70dce-46bb-4eb0-9361-d17cc5e0b711 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '.version_select at 0x7f83e93ed940>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:38.824246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-bea70dce-46bb-4eb0-9361-d17cc5e0b711 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203030134" status: 202 len: 0 microversion: 2.1 time: 0.025414 Sep 06 16:24:38.824845 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 481/979] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Sep 6 16:24:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203030134 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:24:39.061081 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2f193251-1cfd-4d80-83f7-52362d4a9792 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:39.063335 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2f193251-1cfd-4d80-83f7-52362d4a9792 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:39.070017 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2f193251-1cfd-4d80-83f7-52362d4a9792 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:39.070580 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2f193251-1cfd-4d80-83f7-52362d4a9792 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:39.071090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2f193251-1cfd-4d80-83f7-52362d4a9792 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:39.071851 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2f193251-1cfd-4d80-83f7-52362d4a9792 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:39.072366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2f193251-1cfd-4d80-83f7-52362d4a9792 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:39.073020 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2f193251-1cfd-4d80-83f7-52362d4a9792 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:39.103790 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2f193251-1cfd-4d80-83f7-52362d4a9792 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046810 Sep 06 16:24:39.104347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 499/980] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:24:39 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:24:39.182970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c13d4aef-5bbd-4cdd-af23-0e44e13d037d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:39.183449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c13d4aef-5bbd-4cdd-af23-0e44e13d037d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:39.192255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c13d4aef-5bbd-4cdd-af23-0e44e13d037d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:39.192780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c13d4aef-5bbd-4cdd-af23-0e44e13d037d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:39.193214 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c13d4aef-5bbd-4cdd-af23-0e44e13d037d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:39.193917 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c13d4aef-5bbd-4cdd-af23-0e44e13d037d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:39.194366 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c13d4aef-5bbd-4cdd-af23-0e44e13d037d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:39.194982 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c13d4aef-5bbd-4cdd-af23-0e44e13d037d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:39.221202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c13d4aef-5bbd-4cdd-af23-0e44e13d037d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Going to try to terminate instance {{(pid=120669) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:24:39.307830 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c13d4aef-5bbd-4cdd-af23-0e44e13d037d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 204 len: 0 microversion: 2.1 time: 0.128778 Sep 06 16:24:39.308955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 482/981] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:24:39 2022] DELETE /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:24:39.317832 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-10718a7e-fbfa-433a-a7c3-a94330b0f226 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:39.318454 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-10718a7e-fbfa-433a-a7c3-a94330b0f226 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:39.324495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10718a7e-fbfa-433a-a7c3-a94330b0f226 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:39.325263 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10718a7e-fbfa-433a-a7c3-a94330b0f226 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:39.325697 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10718a7e-fbfa-433a-a7c3-a94330b0f226 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:39.326391 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10718a7e-fbfa-433a-a7c3-a94330b0f226 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:39.326842 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10718a7e-fbfa-433a-a7c3-a94330b0f226 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:39.327428 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-10718a7e-fbfa-433a-a7c3-a94330b0f226 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:39.473026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-10718a7e-fbfa-433a-a7c3-a94330b0f226 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:39.473166 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ee7fe798-5f8e-4ef1-b3ff-983729c6d4db tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:39.473166 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ee7fe798-5f8e-4ef1-b3ff-983729c6d4db tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:39.478510 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-10718a7e-fbfa-433a-a7c3-a94330b0f226 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1689 microversion: 2.1 time: 0.160585 Sep 06 16:24:39.478510 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 500/982] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:39 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:24:39.478734 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ee7fe798-5f8e-4ef1-b3ff-983729c6d4db tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:39.478846 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ee7fe798-5f8e-4ef1-b3ff-983729c6d4db tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:39.479186 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ee7fe798-5f8e-4ef1-b3ff-983729c6d4db tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:39.479941 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ee7fe798-5f8e-4ef1-b3ff-983729c6d4db tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:39.480314 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ee7fe798-5f8e-4ef1-b3ff-983729c6d4db tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:39.480715 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ee7fe798-5f8e-4ef1-b3ff-983729c6d4db tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:39.502124 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f698c03e-edee-4f2f-98d4-a0d2887aaa94 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Action: 'create', calling method: .version_select at 0x7f83e93da5e0>, body: {"keypair": {"name": "tempest-keypair-856832064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYRmhjGMtmvsUkDeq7qiGQAF1Tdcz5W17bkWfkHFjXgK1eATxJ7fI/vR2ZuhUYHdZ4ivjgXNCCWphbnNN64hiT6m3N96gdTsHbaGr+POLmNKNVgTVkRFqvE/yo9tA1aow=="}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:39.517692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-f698c03e-edee-4f2f-98d4-a0d2887aaa94 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Getting quotas for project ad0bef00a05c4029a009992a7f96fa80. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:24:39.521618 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-f698c03e-edee-4f2f-98d4-a0d2887aaa94 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Getting quotas for user e225aec64aee47449542aecbec0ae561 and project ad0bef00a05c4029a009992a7f96fa80. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:24:39.545604 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f698c03e-edee-4f2f-98d4-a0d2887aaa94 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047300 Sep 06 16:24:39.546385 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 501/983] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 6 16:24:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:24:39.618898 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ee7fe798-5f8e-4ef1-b3ff-983729c6d4db tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:39.627418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ee7fe798-5f8e-4ef1-b3ff-983729c6d4db tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1259 microversion: 2.1 time: 0.160230 Sep 06 16:24:39.628030 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 483/984] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:39 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:40.497766 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3c745cd0-f5ac-4a19-a563-ec166f81446d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:40.498361 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3c745cd0-f5ac-4a19-a563-ec166f81446d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:40.504612 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c745cd0-f5ac-4a19-a563-ec166f81446d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:40.505130 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c745cd0-f5ac-4a19-a563-ec166f81446d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:40.505555 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c745cd0-f5ac-4a19-a563-ec166f81446d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:40.506244 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c745cd0-f5ac-4a19-a563-ec166f81446d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:40.506679 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c745cd0-f5ac-4a19-a563-ec166f81446d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:40.507092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3c745cd0-f5ac-4a19-a563-ec166f81446d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:40.651411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-bd9be2c1-701b-4305-a251-2c21eab1f47e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:40.652721 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-bd9be2c1-701b-4305-a251-2c21eab1f47e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:40.660451 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bd9be2c1-701b-4305-a251-2c21eab1f47e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:40.661212 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bd9be2c1-701b-4305-a251-2c21eab1f47e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:40.661780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bd9be2c1-701b-4305-a251-2c21eab1f47e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:40.662780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bd9be2c1-701b-4305-a251-2c21eab1f47e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:40.663351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bd9be2c1-701b-4305-a251-2c21eab1f47e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:40.663852 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bd9be2c1-701b-4305-a251-2c21eab1f47e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:40.800009 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3c745cd0-f5ac-4a19-a563-ec166f81446d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:40.809310 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3c745cd0-f5ac-4a19-a563-ec166f81446d tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1689 microversion: 2.1 time: 0.316059 Sep 06 16:24:40.809885 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 502/985] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:40 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1689 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:40.852518 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-bd9be2c1-701b-4305-a251-2c21eab1f47e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:40.860440 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-bd9be2c1-701b-4305-a251-2c21eab1f47e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1259 microversion: 2.1 time: 0.213101 Sep 06 16:24:40.861074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 484/986] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:40 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:40.916674 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-196312067", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a85fb19-0212-415f-99a3-26579fc91ae5"}], "security_groups": [{"name": "tempest-securitygroup--1348780521"}], "key_name": "tempest-keypair-856832064", "user_data": "}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:41.034169 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.network.neutron [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] validate_networks() for [('3a85fb19-0212-415f-99a3-26579fc91ae5', None, None, None, None, None)] {{(pid=120668) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:24:41.419504 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Flavor limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:24:41.420104 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Image limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:24:41.420815 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Flavor pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:24:41.421357 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Image pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:24:41.421820 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:24:41.435795 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:41.436469 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:41.437162 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:41.437990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:41.438446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:41.438868 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:41.456137 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Getting quotas for project ad0bef00a05c4029a009992a7f96fa80. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:24:41.460922 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Getting quotas for user e225aec64aee47449542aecbec0ae561 and project ad0bef00a05c4029a009992a7f96fa80. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:24:41.472196 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Going to run 1 instances... {{(pid=120668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:24:41.474551 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:24:41.524888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6413eb8e-d05f-4c92-9082-7f0a536fe728 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.612560 Sep 06 16:24:41.525547 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 503/987] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:24:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 16:24:41.536708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a7ec1f88-4d22-4adc-b22d-066b76a77782 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:41.537499 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a7ec1f88-4d22-4adc-b22d-066b76a77782 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:41.595235 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a7ec1f88-4d22-4adc-b22d-066b76a77782 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:41.603190 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a7ec1f88-4d22-4adc-b22d-066b76a77782 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1236 microversion: 2.1 time: 0.070242 Sep 06 16:24:41.603741 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 485/988] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:41 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:41.835490 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1747dd5a-947d-4b6a-a086-964775054e24 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:41.836924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1747dd5a-947d-4b6a-a086-964775054e24 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:41.845677 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1747dd5a-947d-4b6a-a086-964775054e24 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:41.846249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1747dd5a-947d-4b6a-a086-964775054e24 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:41.846704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1747dd5a-947d-4b6a-a086-964775054e24 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:41.847388 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1747dd5a-947d-4b6a-a086-964775054e24 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:41.847866 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1747dd5a-947d-4b6a-a086-964775054e24 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:41.848474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1747dd5a-947d-4b6a-a086-964775054e24 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:41.886311 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-dfeadc4c-a6ec-4a29-871d-f3b57b7e9fb7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:41.892709 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-dfeadc4c-a6ec-4a29-871d-f3b57b7e9fb7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:41.903779 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dfeadc4c-a6ec-4a29-871d-f3b57b7e9fb7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:41.904280 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dfeadc4c-a6ec-4a29-871d-f3b57b7e9fb7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:41.904784 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dfeadc4c-a6ec-4a29-871d-f3b57b7e9fb7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:41.905486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dfeadc4c-a6ec-4a29-871d-f3b57b7e9fb7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:41.905934 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dfeadc4c-a6ec-4a29-871d-f3b57b7e9fb7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:41.906664 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-dfeadc4c-a6ec-4a29-871d-f3b57b7e9fb7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:42.000190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1747dd5a-947d-4b6a-a086-964775054e24 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:42.008210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1747dd5a-947d-4b6a-a086-964775054e24 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1689 microversion: 2.1 time: 0.177429 Sep 06 16:24:42.008798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 504/989] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:41 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:42.047316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-dfeadc4c-a6ec-4a29-871d-f3b57b7e9fb7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:42.055591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-dfeadc4c-a6ec-4a29-871d-f3b57b7e9fb7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1259 microversion: 2.1 time: 0.173315 Sep 06 16:24:42.056197 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 486/990] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:41 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:24:42.629809 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e116800c-7a44-457d-9511-25b301ee8fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:42.630855 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e116800c-7a44-457d-9511-25b301ee8fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:42.641544 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e116800c-7a44-457d-9511-25b301ee8fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:42.642023 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e116800c-7a44-457d-9511-25b301ee8fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:42.642437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e116800c-7a44-457d-9511-25b301ee8fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:42.643130 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e116800c-7a44-457d-9511-25b301ee8fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:42.643575 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e116800c-7a44-457d-9511-25b301ee8fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:42.643990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e116800c-7a44-457d-9511-25b301ee8fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:42.648061 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:42.706633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e116800c-7a44-457d-9511-25b301ee8fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:42.714589 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e116800c-7a44-457d-9511-25b301ee8fce tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1240 microversion: 2.1 time: 0.091204 Sep 06 16:24:42.715159 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 505/991] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:42 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:43.031181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-82403994-3d9a-4904-b9ed-c8aaefa1c892 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:43.031835 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-82403994-3d9a-4904-b9ed-c8aaefa1c892 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:43.039302 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82403994-3d9a-4904-b9ed-c8aaefa1c892 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:43.039881 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82403994-3d9a-4904-b9ed-c8aaefa1c892 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:43.040494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82403994-3d9a-4904-b9ed-c8aaefa1c892 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:43.041520 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82403994-3d9a-4904-b9ed-c8aaefa1c892 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:43.042276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82403994-3d9a-4904-b9ed-c8aaefa1c892 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:43.042695 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-82403994-3d9a-4904-b9ed-c8aaefa1c892 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:43.066318 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:43.078739 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-270c618d-db42-4592-a3d2-e98806cfcde0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:43.079334 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-270c618d-db42-4592-a3d2-e98806cfcde0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:43.085688 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-270c618d-db42-4592-a3d2-e98806cfcde0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:43.086243 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-270c618d-db42-4592-a3d2-e98806cfcde0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:43.086743 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-270c618d-db42-4592-a3d2-e98806cfcde0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:43.087447 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-270c618d-db42-4592-a3d2-e98806cfcde0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:43.088032 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-270c618d-db42-4592-a3d2-e98806cfcde0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:43.088459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-270c618d-db42-4592-a3d2-e98806cfcde0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:43.193388 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-82403994-3d9a-4904-b9ed-c8aaefa1c892 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:43.201867 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-82403994-3d9a-4904-b9ed-c8aaefa1c892 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1689 microversion: 2.1 time: 0.174852 Sep 06 16:24:43.202442 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 487/992] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:43 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:43.228433 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-270c618d-db42-4592-a3d2-e98806cfcde0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:43.240145 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-270c618d-db42-4592-a3d2-e98806cfcde0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1443 microversion: 2.1 time: 0.165155 Sep 06 16:24:43.240857 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 506/993] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:43 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:24:43.266480 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4196e1b5-8986-435b-a3ec-5b035dcbc4cd tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:43.267102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4196e1b5-8986-435b-a3ec-5b035dcbc4cd tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:43.273808 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4196e1b5-8986-435b-a3ec-5b035dcbc4cd tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:43.274323 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4196e1b5-8986-435b-a3ec-5b035dcbc4cd tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:43.274759 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4196e1b5-8986-435b-a3ec-5b035dcbc4cd tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:43.275460 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4196e1b5-8986-435b-a3ec-5b035dcbc4cd tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:43.275912 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4196e1b5-8986-435b-a3ec-5b035dcbc4cd tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:43.276335 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4196e1b5-8986-435b-a3ec-5b035dcbc4cd tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:43.425578 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4196e1b5-8986-435b-a3ec-5b035dcbc4cd tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:43.434213 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4196e1b5-8986-435b-a3ec-5b035dcbc4cd tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1443 microversion: 2.1 time: 0.174075 Sep 06 16:24:43.434787 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 488/994] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:43 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:43.737997 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-04e5b006-9e1f-4835-97c6-5df347f75d5e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:43.739637 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-04e5b006-9e1f-4835-97c6-5df347f75d5e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:43.747133 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04e5b006-9e1f-4835-97c6-5df347f75d5e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:43.747600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04e5b006-9e1f-4835-97c6-5df347f75d5e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:43.748031 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04e5b006-9e1f-4835-97c6-5df347f75d5e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:43.748739 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04e5b006-9e1f-4835-97c6-5df347f75d5e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:43.749250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04e5b006-9e1f-4835-97c6-5df347f75d5e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:43.749668 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04e5b006-9e1f-4835-97c6-5df347f75d5e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:43.814446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-04e5b006-9e1f-4835-97c6-5df347f75d5e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:43.823050 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-04e5b006-9e1f-4835-97c6-5df347f75d5e tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1232 microversion: 2.1 time: 0.089117 Sep 06 16:24:43.824067 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 507/995] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:43 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1232 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:44.224828 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3c533f67-b8d9-47c9-b419-d176d5e8582f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:44.225504 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-3c533f67-b8d9-47c9-b419-d176d5e8582f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:44.232262 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c533f67-b8d9-47c9-b419-d176d5e8582f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:44.232776 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c533f67-b8d9-47c9-b419-d176d5e8582f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:44.233210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c533f67-b8d9-47c9-b419-d176d5e8582f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:44.233901 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c533f67-b8d9-47c9-b419-d176d5e8582f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:44.234364 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c533f67-b8d9-47c9-b419-d176d5e8582f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:44.234856 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3c533f67-b8d9-47c9-b419-d176d5e8582f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:44.573217 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-3c533f67-b8d9-47c9-b419-d176d5e8582f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:44.583893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-3c533f67-b8d9-47c9-b419-d176d5e8582f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1689 microversion: 2.1 time: 0.363028 Sep 06 16:24:44.584484 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 489/996] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:44 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1689 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:44.846928 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-20f99100-5980-40ce-a8ee-08a15cbf919a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:44.848306 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-20f99100-5980-40ce-a8ee-08a15cbf919a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:44.855573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-20f99100-5980-40ce-a8ee-08a15cbf919a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:44.856433 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-20f99100-5980-40ce-a8ee-08a15cbf919a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:44.857142 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-20f99100-5980-40ce-a8ee-08a15cbf919a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:44.858193 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-20f99100-5980-40ce-a8ee-08a15cbf919a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:44.858885 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-20f99100-5980-40ce-a8ee-08a15cbf919a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:44.859577 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-20f99100-5980-40ce-a8ee-08a15cbf919a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:44.939802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-20f99100-5980-40ce-a8ee-08a15cbf919a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:44.948372 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-20f99100-5980-40ce-a8ee-08a15cbf919a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1294 microversion: 2.1 time: 0.105632 Sep 06 16:24:44.949600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 508/997] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:44 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:45.609933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-bb81493a-057b-4d1a-9494-396f5f08e3a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:45.612331 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-bb81493a-057b-4d1a-9494-396f5f08e3a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:45.623676 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bb81493a-057b-4d1a-9494-396f5f08e3a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:45.624166 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bb81493a-057b-4d1a-9494-396f5f08e3a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:45.624863 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bb81493a-057b-4d1a-9494-396f5f08e3a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:45.625644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bb81493a-057b-4d1a-9494-396f5f08e3a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:45.626334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bb81493a-057b-4d1a-9494-396f5f08e3a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:45.626978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bb81493a-057b-4d1a-9494-396f5f08e3a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:45.746635 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-bb81493a-057b-4d1a-9494-396f5f08e3a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:45.755965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-bb81493a-057b-4d1a-9494-396f5f08e3a7 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1622 microversion: 2.1 time: 0.151192 Sep 06 16:24:45.765199 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 490/998] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:45 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1622 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:45.972319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-97598d9c-e062-4dce-a414-f9f2c028bc2c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:45.973077 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-97598d9c-e062-4dce-a414-f9f2c028bc2c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:45.980993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-97598d9c-e062-4dce-a414-f9f2c028bc2c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:45.981475 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-97598d9c-e062-4dce-a414-f9f2c028bc2c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:45.981896 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-97598d9c-e062-4dce-a414-f9f2c028bc2c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:45.982578 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-97598d9c-e062-4dce-a414-f9f2c028bc2c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:45.983246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-97598d9c-e062-4dce-a414-f9f2c028bc2c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:45.983667 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-97598d9c-e062-4dce-a414-f9f2c028bc2c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:46.026653 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-70bad993-790e-4db9-b4da-afe5df336a73 req-759eb953-4991-4fb0-ac1f-c45ee9ff2a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ff1c2e-7944-4480-8fe9-47bf5417cbd6", "name": "network-vif-deleted", "tag": "72ac5ea6-8d72-4bdb-9f41-ad02915d59c5"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:46.057558 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-97598d9c-e062-4dce-a414-f9f2c028bc2c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:46.060549 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-70bad993-790e-4db9-b4da-afe5df336a73 req-759eb953-4991-4fb0-ac1f-c45ee9ff2a8c service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:46.061520 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-70bad993-790e-4db9-b4da-afe5df336a73 req-759eb953-4991-4fb0-ac1f-c45ee9ff2a8c service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:46.062127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-70bad993-790e-4db9-b4da-afe5df336a73 req-759eb953-4991-4fb0-ac1f-c45ee9ff2a8c service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:46.065733 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-97598d9c-e062-4dce-a414-f9f2c028bc2c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1294 microversion: 2.1 time: 0.097296 Sep 06 16:24:46.067558 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 509/999] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:45 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:46.082902 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-70bad993-790e-4db9-b4da-afe5df336a73 req-759eb953-4991-4fb0-ac1f-c45ee9ff2a8c service nova] Creating event network-vif-deleted:72ac5ea6-8d72-4bdb-9f41-ad02915d59c5 for instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 on hv-cinder-85221 Sep 06 16:24:46.088949 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-70bad993-790e-4db9-b4da-afe5df336a73 req-759eb953-4991-4fb0-ac1f-c45ee9ff2a8c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080002 Sep 06 16:24:46.089714 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 491/1000] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:46.779669 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:46.780302 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:46.791938 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:46.792486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:46.793003 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:46.793708 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:46.794337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:46.794918 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:46.834407 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:46.835144 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:46.835745 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:46.836351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lazy-loading 'fault' on Instance uuid c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:24:46.893153 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:46.905653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-19964a5e-cfa7-46ec-8bf6-d6b702f94a57 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 200 len: 1336 microversion: 2.1 time: 0.130025 Sep 06 16:24:46.921769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 510/1001] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:46 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 1336 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:47.091761 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-2de77a0f-a629-446d-9d65-861d905f9d35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:47.092629 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-2de77a0f-a629-446d-9d65-861d905f9d35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:47.103752 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2de77a0f-a629-446d-9d65-861d905f9d35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:47.104717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2de77a0f-a629-446d-9d65-861d905f9d35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:47.105366 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2de77a0f-a629-446d-9d65-861d905f9d35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:47.106240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2de77a0f-a629-446d-9d65-861d905f9d35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:47.106904 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2de77a0f-a629-446d-9d65-861d905f9d35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:47.107483 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2de77a0f-a629-446d-9d65-861d905f9d35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:47.345067 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-2de77a0f-a629-446d-9d65-861d905f9d35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:47.356962 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-2de77a0f-a629-446d-9d65-861d905f9d35 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1362 microversion: 2.1 time: 0.270316 Sep 06 16:24:47.357926 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 492/1002] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:47 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:24:47.930585 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e35d9e35-1aca-4467-95be-3c2fa699f464 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:47.931239 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e35d9e35-1aca-4467-95be-3c2fa699f464 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: c0ff1c2e-7944-4480-8fe9-47bf5417cbd6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:47.938241 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e35d9e35-1aca-4467-95be-3c2fa699f464 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:47.938726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e35d9e35-1aca-4467-95be-3c2fa699f464 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:47.939189 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e35d9e35-1aca-4467-95be-3c2fa699f464 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:47.939918 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e35d9e35-1aca-4467-95be-3c2fa699f464 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:47.940399 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e35d9e35-1aca-4467-95be-3c2fa699f464 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:47.940843 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e35d9e35-1aca-4467-95be-3c2fa699f464 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:47.954972 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-e35d9e35-1aca-4467-95be-3c2fa699f464 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] HTTP exception thrown: Instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 could not be found. Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e35d9e35-1aca-4467-95be-3c2fa699f464 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Request method failure captured: Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 HTTP/1.1 Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3JE-mvXJfafJGdfInwGWFXyX8vm1TCi2ot3YdwYrF-4Edt8_xnBZLKdft-iOh0bGqcZkuWHUjnbHFyY4JyAcYYwqblm10OkwpxcwVN1Q9ztdopxT5kE1EybmUKrN1PEAiAMDv4KZA1PhL7NR0vL4LK6Q15ypGJ6vu_af7tN1gEPvCI Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 49a3e0cfba224a119bf8aaf26ae583f4 Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:24:47.956525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:24:47.958200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:24:47.958200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:24:47.958200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 49a3e0cfba224a119bf8aaf26ae583f4 Sep 06 16:24:47.958200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:24:47.958200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-ServerRescueNegativeTestJSON-843887898-project Sep 06 16:24:47.958200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:24:47.958200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:24:47.958200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 93096a58fcb34f2085a05ffa40df5937 Sep 06 16:24:47.958200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-ServerRescueNegativeTestJSON-843887898-project Sep 06 16:24:47.958200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:24:47.958200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 could not be found. Sep 06 16:24:47.958200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'c0ff1c2e-7944-4480-8fe9-47bf5417cbd6'} Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 could not be found. Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:24:47.959121 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 could not be found. Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 could not be found. Sep 06 16:24:47.960673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:47.961930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e35d9e35-1aca-4467-95be-3c2fa699f464 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Returning 404 to user: Instance c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:24:47.961930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e35d9e35-1aca-4467-95be-3c2fa699f464 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6" status: 404 len: 111 microversion: 2.1 time: 0.031835 Sep 06 16:24:47.962765 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 511/1003] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:47 2022] GET /compute/v2.1/servers/c0ff1c2e-7944-4480-8fe9-47bf5417cbd6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:24:47.966947 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-56b7a7b0-d690-4d6c-bcda-7f4d466acbde tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '.version_select at 0x7f83e9449f70>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:47.987895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-56b7a7b0-d690-4d6c-bcda-7f4d466acbde tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069068681" status: 202 len: 0 microversion: 2.1 time: 0.024791 Sep 06 16:24:47.988779 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 493/1004] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Sep 6 16:24:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069068681 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 16:24:48.118642 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-ee3425c7-ff48-4d1a-aaff-74731c487a7f req-5dadc5f9-abdc-475c-bfbf-bab6132ed2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993ac4a3-a4e1-43cb-b6da-af83833f1396", "tag": "b8387b10-ca79-44d9-bb60-26753cfeeac9"}, {"name": "network-changed", "server_uuid": "a39987c5-d718-40b4-804f-328144e58e8b", "tag": "d0c9b9f7-0d8c-4c96-8253-1d2ea33d8104"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:48.132805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-ee3425c7-ff48-4d1a-aaff-74731c487a7f req-5dadc5f9-abdc-475c-bfbf-bab6132ed2fa service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:48.133713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-ee3425c7-ff48-4d1a-aaff-74731c487a7f req-5dadc5f9-abdc-475c-bfbf-bab6132ed2fa service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:48.134438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-ee3425c7-ff48-4d1a-aaff-74731c487a7f req-5dadc5f9-abdc-475c-bfbf-bab6132ed2fa service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:48.152947 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-ee3425c7-ff48-4d1a-aaff-74731c487a7f req-5dadc5f9-abdc-475c-bfbf-bab6132ed2fa service nova] Creating event network-changed:b8387b10-ca79-44d9-bb60-26753cfeeac9 for instance 993ac4a3-a4e1-43cb-b6da-af83833f1396 on hv-cinder-85221 Sep 06 16:24:48.154355 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-ee3425c7-ff48-4d1a-aaff-74731c487a7f req-5dadc5f9-abdc-475c-bfbf-bab6132ed2fa service nova] Creating event network-changed:d0c9b9f7-0d8c-4c96-8253-1d2ea33d8104 for instance a39987c5-d718-40b4-804f-328144e58e8b on hv-cinder-85221 Sep 06 16:24:48.162891 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-ee3425c7-ff48-4d1a-aaff-74731c487a7f req-5dadc5f9-abdc-475c-bfbf-bab6132ed2fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047671 Sep 06 16:24:48.164045 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 512/1005] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:24:48.380059 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ae8d4fc3-5990-48d3-9b9b-7790ee0c736f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:48.380728 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ae8d4fc3-5990-48d3-9b9b-7790ee0c736f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:48.387742 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ae8d4fc3-5990-48d3-9b9b-7790ee0c736f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:48.388233 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ae8d4fc3-5990-48d3-9b9b-7790ee0c736f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:48.388685 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ae8d4fc3-5990-48d3-9b9b-7790ee0c736f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:48.389454 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ae8d4fc3-5990-48d3-9b9b-7790ee0c736f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:48.389906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ae8d4fc3-5990-48d3-9b9b-7790ee0c736f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:48.390329 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ae8d4fc3-5990-48d3-9b9b-7790ee0c736f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:48.800417 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ae8d4fc3-5990-48d3-9b9b-7790ee0c736f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:48.809141 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ae8d4fc3-5990-48d3-9b9b-7790ee0c736f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1362 microversion: 2.1 time: 0.433127 Sep 06 16:24:48.809717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 494/1006] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:48 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:49.837427 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3b844f1c-940c-412c-9f5e-96cfb044a1e8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:49.838503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3b844f1c-940c-412c-9f5e-96cfb044a1e8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:49.848245 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3b844f1c-940c-412c-9f5e-96cfb044a1e8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:49.848720 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3b844f1c-940c-412c-9f5e-96cfb044a1e8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:49.849179 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3b844f1c-940c-412c-9f5e-96cfb044a1e8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:49.849865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3b844f1c-940c-412c-9f5e-96cfb044a1e8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:49.850310 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3b844f1c-940c-412c-9f5e-96cfb044a1e8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:49.850754 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3b844f1c-940c-412c-9f5e-96cfb044a1e8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:49.996705 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3b844f1c-940c-412c-9f5e-96cfb044a1e8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:50.005046 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3b844f1c-940c-412c-9f5e-96cfb044a1e8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1362 microversion: 2.1 time: 0.174861 Sep 06 16:24:50.005606 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 513/1007] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:49 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:51.032329 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-531c4d86-7b4c-4cfd-a123-9abec17cb300 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:51.033399 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-531c4d86-7b4c-4cfd-a123-9abec17cb300 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:51.043728 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-531c4d86-7b4c-4cfd-a123-9abec17cb300 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:51.044526 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-531c4d86-7b4c-4cfd-a123-9abec17cb300 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:51.045340 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-531c4d86-7b4c-4cfd-a123-9abec17cb300 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:51.047673 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-531c4d86-7b4c-4cfd-a123-9abec17cb300 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:51.048127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-531c4d86-7b4c-4cfd-a123-9abec17cb300 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:51.048561 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-531c4d86-7b4c-4cfd-a123-9abec17cb300 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:51.208121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-531c4d86-7b4c-4cfd-a123-9abec17cb300 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:51.216555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-531c4d86-7b4c-4cfd-a123-9abec17cb300 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1362 microversion: 2.1 time: 0.191058 Sep 06 16:24:51.217230 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 495/1008] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:51 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:51.384078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5c279288-0b74-4bdf-94ae-a2461218199a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:51.384585 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5c279288-0b74-4bdf-94ae-a2461218199a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:51.391544 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5c279288-0b74-4bdf-94ae-a2461218199a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:51.392027 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5c279288-0b74-4bdf-94ae-a2461218199a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:51.392454 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5c279288-0b74-4bdf-94ae-a2461218199a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:51.393171 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5c279288-0b74-4bdf-94ae-a2461218199a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:51.393615 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5c279288-0b74-4bdf-94ae-a2461218199a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:51.394027 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5c279288-0b74-4bdf-94ae-a2461218199a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:51.420064 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5c279288-0b74-4bdf-94ae-a2461218199a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Going to try to terminate instance {{(pid=120668) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:24:51.448084 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:51.467597 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=10 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:51.500006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5c279288-0b74-4bdf-94ae-a2461218199a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 204 len: 0 microversion: 2.1 time: 0.119464 Sep 06 16:24:51.501475 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 514/1009] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:24:51 2022] DELETE /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:24:51.509419 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-2029928e-a127-465c-90a7-8f60933cebc4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:51.510023 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-2029928e-a127-465c-90a7-8f60933cebc4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:51.516318 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2029928e-a127-465c-90a7-8f60933cebc4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:51.516940 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2029928e-a127-465c-90a7-8f60933cebc4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:51.517388 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2029928e-a127-465c-90a7-8f60933cebc4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:51.523820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2029928e-a127-465c-90a7-8f60933cebc4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:51.524642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2029928e-a127-465c-90a7-8f60933cebc4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:51.525010 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2029928e-a127-465c-90a7-8f60933cebc4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:51.600295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:51.667775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-2029928e-a127-465c-90a7-8f60933cebc4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:51.681377 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-2029928e-a127-465c-90a7-8f60933cebc4 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1508 microversion: 2.1 time: 0.175526 Sep 06 16:24:51.682425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 496/1010] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:51 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:52.240400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-383f913a-7cf5-4e0d-8243-e259e9a52fbf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:52.241262 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-383f913a-7cf5-4e0d-8243-e259e9a52fbf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:52.245701 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:52.248151 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-383f913a-7cf5-4e0d-8243-e259e9a52fbf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:52.248501 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-383f913a-7cf5-4e0d-8243-e259e9a52fbf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:52.248981 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-383f913a-7cf5-4e0d-8243-e259e9a52fbf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:52.249710 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-383f913a-7cf5-4e0d-8243-e259e9a52fbf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:52.250158 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-383f913a-7cf5-4e0d-8243-e259e9a52fbf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:52.250610 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-383f913a-7cf5-4e0d-8243-e259e9a52fbf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:52.387288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-383f913a-7cf5-4e0d-8243-e259e9a52fbf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:52.395941 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-383f913a-7cf5-4e0d-8243-e259e9a52fbf tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1362 microversion: 2.1 time: 0.159902 Sep 06 16:24:52.396550 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 515/1011] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:52 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:52.705601 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9d6b00bc-fddb-4ad8-b8a6-04e82e078c2a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:52.706239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9d6b00bc-fddb-4ad8-b8a6-04e82e078c2a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:52.712882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9d6b00bc-fddb-4ad8-b8a6-04e82e078c2a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:52.713353 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9d6b00bc-fddb-4ad8-b8a6-04e82e078c2a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:52.713819 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9d6b00bc-fddb-4ad8-b8a6-04e82e078c2a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:52.714520 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9d6b00bc-fddb-4ad8-b8a6-04e82e078c2a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:52.714978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9d6b00bc-fddb-4ad8-b8a6-04e82e078c2a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:52.715398 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9d6b00bc-fddb-4ad8-b8a6-04e82e078c2a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:52.906067 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9d6b00bc-fddb-4ad8-b8a6-04e82e078c2a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:52.914806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9d6b00bc-fddb-4ad8-b8a6-04e82e078c2a tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 200 len: 1508 microversion: 2.1 time: 0.213173 Sep 06 16:24:52.915762 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 497/1012] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:52 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:53.010198 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-c012b279-f06d-4d09-8e57-2f5dea9ab15b req-799a95da-9b28-4e96-8c6a-bbe5134d20b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0088f479-7a4c-4bf2-909d-f7caf1795be8", "name": "network-vif-deleted", "tag": "9b788b0b-0011-463e-88c6-ea88f1a5652f"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:53.021863 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c012b279-f06d-4d09-8e57-2f5dea9ab15b req-799a95da-9b28-4e96-8c6a-bbe5134d20b5 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:53.022336 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c012b279-f06d-4d09-8e57-2f5dea9ab15b req-799a95da-9b28-4e96-8c6a-bbe5134d20b5 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:53.022766 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c012b279-f06d-4d09-8e57-2f5dea9ab15b req-799a95da-9b28-4e96-8c6a-bbe5134d20b5 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:53.036230 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-c012b279-f06d-4d09-8e57-2f5dea9ab15b req-799a95da-9b28-4e96-8c6a-bbe5134d20b5 service nova] Creating event network-vif-deleted:9b788b0b-0011-463e-88c6-ea88f1a5652f for instance 0088f479-7a4c-4bf2-909d-f7caf1795be8 on hv-cinder-85221 Sep 06 16:24:53.041246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-c012b279-f06d-4d09-8e57-2f5dea9ab15b req-799a95da-9b28-4e96-8c6a-bbe5134d20b5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034561 Sep 06 16:24:53.042199 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 516/1013] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:53.419295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e7c4b843-14ea-4b6f-b8fb-6b04fedc2512 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:53.419907 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e7c4b843-14ea-4b6f-b8fb-6b04fedc2512 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:53.426301 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c4b843-14ea-4b6f-b8fb-6b04fedc2512 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:53.426943 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c4b843-14ea-4b6f-b8fb-6b04fedc2512 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:53.427331 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c4b843-14ea-4b6f-b8fb-6b04fedc2512 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:53.428013 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c4b843-14ea-4b6f-b8fb-6b04fedc2512 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:53.428889 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c4b843-14ea-4b6f-b8fb-6b04fedc2512 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:53.429393 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e7c4b843-14ea-4b6f-b8fb-6b04fedc2512 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:53.564599 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e7c4b843-14ea-4b6f-b8fb-6b04fedc2512 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:53.572990 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e7c4b843-14ea-4b6f-b8fb-6b04fedc2512 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1362 microversion: 2.1 time: 0.157737 Sep 06 16:24:53.573563 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 498/1014] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:53 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:53.939358 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e4e21caa-ca42-41fe-a61e-c4efb6ec0485 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:53.940046 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e4e21caa-ca42-41fe-a61e-c4efb6ec0485 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 0088f479-7a4c-4bf2-909d-f7caf1795be8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:53.946725 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4e21caa-ca42-41fe-a61e-c4efb6ec0485 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:53.947206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4e21caa-ca42-41fe-a61e-c4efb6ec0485 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:53.947635 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4e21caa-ca42-41fe-a61e-c4efb6ec0485 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:53.948322 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4e21caa-ca42-41fe-a61e-c4efb6ec0485 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:53.948789 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4e21caa-ca42-41fe-a61e-c4efb6ec0485 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:53.949214 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e4e21caa-ca42-41fe-a61e-c4efb6ec0485 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:53.962873 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-e4e21caa-ca42-41fe-a61e-c4efb6ec0485 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] HTTP exception thrown: Instance 0088f479-7a4c-4bf2-909d-f7caf1795be8 could not be found. Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e4e21caa-ca42-41fe-a61e-c4efb6ec0485 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Request method failure captured: Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 HTTP/1.1 Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3JE-mvXJfafJGdfInwGWFXyX8vm1TCi2ot3YdwYrF-4Edt8_xnBZLKdft-iOh0bGqcZkuWHUjnbHFyY4JyAcYYwqblm10OkwpxcwVN1Q9ztdopxT5kE1EybmUKrN1PEAiAMDv4KZA1PhL7NR0vL4LK6Q15ypGJ6vu_af7tN1gEPvCI Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 49a3e0cfba224a119bf8aaf26ae583f4 Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:24:53.964506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:24:53.966204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:24:53.966204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:24:53.966204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 49a3e0cfba224a119bf8aaf26ae583f4 Sep 06 16:24:53.966204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:24:53.966204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-ServerRescueNegativeTestJSON-843887898-project Sep 06 16:24:53.966204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:24:53.966204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:24:53.966204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 93096a58fcb34f2085a05ffa40df5937 Sep 06 16:24:53.966204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-ServerRescueNegativeTestJSON-843887898-project Sep 06 16:24:53.966204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:24:53.966204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance 0088f479-7a4c-4bf2-909d-f7caf1795be8 could not be found. Sep 06 16:24:53.966204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': '0088f479-7a4c-4bf2-909d-f7caf1795be8'} Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0088f479-7a4c-4bf2-909d-f7caf1795be8 could not be found. Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:24:53.967503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0088f479-7a4c-4bf2-909d-f7caf1795be8 could not be found. Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0088f479-7a4c-4bf2-909d-f7caf1795be8 could not be found. Sep 06 16:24:53.969371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:53.971612 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e4e21caa-ca42-41fe-a61e-c4efb6ec0485 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Returning 404 to user: Instance 0088f479-7a4c-4bf2-909d-f7caf1795be8 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:24:53.971612 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e4e21caa-ca42-41fe-a61e-c4efb6ec0485 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8" status: 404 len: 111 microversion: 2.1 time: 0.031359 Sep 06 16:24:53.971612 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 517/1015] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:53 2022] GET /compute/v2.1/servers/0088f479-7a4c-4bf2-909d-f7caf1795be8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:24:53.975117 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0c34cacd-89ca-458b-aca4-5f541749f6ad tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:53.975755 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0c34cacd-89ca-458b-aca4-5f541749f6ad tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:53.982721 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0c34cacd-89ca-458b-aca4-5f541749f6ad tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:53.983202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0c34cacd-89ca-458b-aca4-5f541749f6ad tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:53.983639 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0c34cacd-89ca-458b-aca4-5f541749f6ad tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:53.984366 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0c34cacd-89ca-458b-aca4-5f541749f6ad tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:53.984826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0c34cacd-89ca-458b-aca4-5f541749f6ad tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:53.985378 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0c34cacd-89ca-458b-aca4-5f541749f6ad tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:54.011081 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0c34cacd-89ca-458b-aca4-5f541749f6ad tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Going to try to terminate instance {{(pid=120669) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:24:54.094289 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0c34cacd-89ca-458b-aca4-5f541749f6ad tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "DELETE /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 204 len: 0 microversion: 2.1 time: 0.123088 Sep 06 16:24:54.095596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 499/1016] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:24:53 2022] DELETE /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:24:54.103888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-941c3db5-135c-432d-a7fc-e2017a6b6436 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:54.104472 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-941c3db5-135c-432d-a7fc-e2017a6b6436 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:54.111394 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-941c3db5-135c-432d-a7fc-e2017a6b6436 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:54.111966 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-941c3db5-135c-432d-a7fc-e2017a6b6436 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:54.112399 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-941c3db5-135c-432d-a7fc-e2017a6b6436 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:54.113123 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-941c3db5-135c-432d-a7fc-e2017a6b6436 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:54.113556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-941c3db5-135c-432d-a7fc-e2017a6b6436 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:54.114108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-941c3db5-135c-432d-a7fc-e2017a6b6436 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:54.247865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-941c3db5-135c-432d-a7fc-e2017a6b6436 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:54.256185 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-941c3db5-135c-432d-a7fc-e2017a6b6436 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1523 microversion: 2.1 time: 0.156386 Sep 06 16:24:54.256742 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 518/1017] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:54 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:54.609005 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-49d02910-2c0f-4c81-98b0-f22330e9291f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:54.609808 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-49d02910-2c0f-4c81-98b0-f22330e9291f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:54.613171 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:54.617263 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49d02910-2c0f-4c81-98b0-f22330e9291f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:54.617748 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49d02910-2c0f-4c81-98b0-f22330e9291f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:54.618172 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49d02910-2c0f-4c81-98b0-f22330e9291f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:54.618868 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49d02910-2c0f-4c81-98b0-f22330e9291f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:54.619316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49d02910-2c0f-4c81-98b0-f22330e9291f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:54.619720 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-49d02910-2c0f-4c81-98b0-f22330e9291f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:54.765581 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-49d02910-2c0f-4c81-98b0-f22330e9291f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:54.773617 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-49d02910-2c0f-4c81-98b0-f22330e9291f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1362 microversion: 2.1 time: 0.172428 Sep 06 16:24:54.774211 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 500/1018] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:54 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:55.280608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4116ebe8-c01a-4530-af4e-2c7ff3e9914f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:55.281233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4116ebe8-c01a-4530-af4e-2c7ff3e9914f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:55.287383 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4116ebe8-c01a-4530-af4e-2c7ff3e9914f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:55.287857 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4116ebe8-c01a-4530-af4e-2c7ff3e9914f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:55.288280 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4116ebe8-c01a-4530-af4e-2c7ff3e9914f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:55.289024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4116ebe8-c01a-4530-af4e-2c7ff3e9914f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:55.289469 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4116ebe8-c01a-4530-af4e-2c7ff3e9914f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:55.289880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4116ebe8-c01a-4530-af4e-2c7ff3e9914f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:55.366618 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4116ebe8-c01a-4530-af4e-2c7ff3e9914f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93096a58fcb34f2085a05ffa40df5937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a3e0cfba224a119bf8aaf26ae583f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:55.374518 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4116ebe8-c01a-4530-af4e-2c7ff3e9914f tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 200 len: 1481 microversion: 2.1 time: 0.098702 Sep 06 16:24:55.375384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 519/1019] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:55 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 1481 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:55.398670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-1f33282f-4088-4feb-8348-8b4f17d1ef7d req-aff130d0-095d-4744-99ad-b93a35327930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d1b8c7-0e2d-4897-9945-2c9b6dec52a9", "name": "network-vif-deleted", "tag": "f0247727-02b0-4655-ace0-070a17630877"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:55.409347 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-1f33282f-4088-4feb-8348-8b4f17d1ef7d req-aff130d0-095d-4744-99ad-b93a35327930 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:55.409826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-1f33282f-4088-4feb-8348-8b4f17d1ef7d req-aff130d0-095d-4744-99ad-b93a35327930 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:55.410253 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-1f33282f-4088-4feb-8348-8b4f17d1ef7d req-aff130d0-095d-4744-99ad-b93a35327930 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:55.421532 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-1f33282f-4088-4feb-8348-8b4f17d1ef7d req-aff130d0-095d-4744-99ad-b93a35327930 service nova] Creating event network-vif-deleted:f0247727-02b0-4655-ace0-070a17630877 for instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 on hv-cinder-85221 Sep 06 16:24:55.426537 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-1f33282f-4088-4feb-8348-8b4f17d1ef7d req-aff130d0-095d-4744-99ad-b93a35327930 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031907 Sep 06 16:24:55.427348 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 501/1020] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:55.795617 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-95939453-b198-42b9-9d22-33b74eafb458 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:55.796222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-95939453-b198-42b9-9d22-33b74eafb458 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:55.802364 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-95939453-b198-42b9-9d22-33b74eafb458 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:55.802850 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-95939453-b198-42b9-9d22-33b74eafb458 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:55.803623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-95939453-b198-42b9-9d22-33b74eafb458 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:55.804349 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-95939453-b198-42b9-9d22-33b74eafb458 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:55.804945 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-95939453-b198-42b9-9d22-33b74eafb458 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:55.805300 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-95939453-b198-42b9-9d22-33b74eafb458 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:55.943265 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-95939453-b198-42b9-9d22-33b74eafb458 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:55.955429 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-95939453-b198-42b9-9d22-33b74eafb458 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1362 microversion: 2.1 time: 0.163439 Sep 06 16:24:55.956200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 520/1021] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:55 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:56.168041 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-5d43bd3e-112b-4b7b-8c69-477aaaa3f65b req-0c504a77-f646-4f81-b762-aa16a9028248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a39987c5-d718-40b4-804f-328144e58e8b", "name": "network-vif-plugged", "status": "completed", "tag": "d0c9b9f7-0d8c-4c96-8253-1d2ea33d8104"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:56.177851 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5d43bd3e-112b-4b7b-8c69-477aaaa3f65b req-0c504a77-f646-4f81-b762-aa16a9028248 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:56.178743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5d43bd3e-112b-4b7b-8c69-477aaaa3f65b req-0c504a77-f646-4f81-b762-aa16a9028248 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:56.179170 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5d43bd3e-112b-4b7b-8c69-477aaaa3f65b req-0c504a77-f646-4f81-b762-aa16a9028248 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:56.194815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-5d43bd3e-112b-4b7b-8c69-477aaaa3f65b req-0c504a77-f646-4f81-b762-aa16a9028248 service nova] Creating event network-vif-plugged:d0c9b9f7-0d8c-4c96-8253-1d2ea33d8104 for instance a39987c5-d718-40b4-804f-328144e58e8b on hv-cinder-85221 Sep 06 16:24:56.199561 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-5d43bd3e-112b-4b7b-8c69-477aaaa3f65b req-0c504a77-f646-4f81-b762-aa16a9028248 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035657 Sep 06 16:24:56.200204 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 502/1022] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:56.397726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-03f2f61b-2867-47fa-ade8-df59a8cf5699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:56.398444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-03f2f61b-2867-47fa-ade8-df59a8cf5699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] [instance: 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:56.405942 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03f2f61b-2867-47fa-ade8-df59a8cf5699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:56.406472 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03f2f61b-2867-47fa-ade8-df59a8cf5699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:56.406834 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03f2f61b-2867-47fa-ade8-df59a8cf5699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:56.407843 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03f2f61b-2867-47fa-ade8-df59a8cf5699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:56.408451 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03f2f61b-2867-47fa-ade8-df59a8cf5699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:56.408895 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03f2f61b-2867-47fa-ade8-df59a8cf5699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:56.431051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-03f2f61b-2867-47fa-ade8-df59a8cf5699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] HTTP exception thrown: Instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 could not be found. Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-03f2f61b-2867-47fa-ade8-df59a8cf5699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Request method failure captured: Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 HTTP/1.1 Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3JE-mvXJfafJGdfInwGWFXyX8vm1TCi2ot3YdwYrF-4Edt8_xnBZLKdft-iOh0bGqcZkuWHUjnbHFyY4JyAcYYwqblm10OkwpxcwVN1Q9ztdopxT5kE1EybmUKrN1PEAiAMDv4KZA1PhL7NR0vL4LK6Q15ypGJ6vu_af7tN1gEPvCI Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 49a3e0cfba224a119bf8aaf26ae583f4 Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:24:56.432633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:24:56.434288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/49a3e0cfba224a119bf8aaf26ae583f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:24:56.434288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:24:56.434288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 49a3e0cfba224a119bf8aaf26ae583f4 Sep 06 16:24:56.434288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-843887898 Sep 06 16:24:56.434288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-ServerRescueNegativeTestJSON-843887898-project Sep 06 16:24:56.434288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:24:56.434288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:24:56.434288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 93096a58fcb34f2085a05ffa40df5937 Sep 06 16:24:56.434288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-ServerRescueNegativeTestJSON-843887898-project Sep 06 16:24:56.434288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:24:56.434288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 could not be found. Sep 06 16:24:56.434288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': '18d1b8c7-0e2d-4897-9945-2c9b6dec52a9'} Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 could not be found. Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:24:56.435163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 could not be found. Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 could not be found. Sep 06 16:24:56.436608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:24:56.439198 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-03f2f61b-2867-47fa-ade8-df59a8cf5699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] Returning 404 to user: Instance 18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:24:56.440043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-03f2f61b-2867-47fa-ade8-df59a8cf5699 tempest-ServerRescueNegativeTestJSON-843887898 tempest-ServerRescueNegativeTestJSON-843887898-project] 10.222.0.43 "GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9" status: 404 len: 111 microversion: 2.1 time: 0.046355 Sep 06 16:24:56.440591 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 521/1023] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:56 2022] GET /compute/v2.1/servers/18d1b8c7-0e2d-4897-9945-2c9b6dec52a9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:24:56.987132 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b0b2a143-145e-4107-9df2-132de0b172a8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:56.987873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b0b2a143-145e-4107-9df2-132de0b172a8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:56.996170 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b0b2a143-145e-4107-9df2-132de0b172a8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:56.996671 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b0b2a143-145e-4107-9df2-132de0b172a8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:56.997110 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b0b2a143-145e-4107-9df2-132de0b172a8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:56.997798 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b0b2a143-145e-4107-9df2-132de0b172a8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:56.998304 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b0b2a143-145e-4107-9df2-132de0b172a8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:56.998876 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b0b2a143-145e-4107-9df2-132de0b172a8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:57.135226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b0b2a143-145e-4107-9df2-132de0b172a8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:57.143151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b0b2a143-145e-4107-9df2-132de0b172a8 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1362 microversion: 2.1 time: 0.162548 Sep 06 16:24:57.143722 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 503/1024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:56 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:58.166451 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a6140531-3178-4964-adf6-e1b8a1264276 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:58.167725 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a6140531-3178-4964-adf6-e1b8a1264276 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:58.174456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a6140531-3178-4964-adf6-e1b8a1264276 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:58.182729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a6140531-3178-4964-adf6-e1b8a1264276 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:58.183480 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a6140531-3178-4964-adf6-e1b8a1264276 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:58.184435 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a6140531-3178-4964-adf6-e1b8a1264276 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:58.185128 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a6140531-3178-4964-adf6-e1b8a1264276 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:58.185763 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a6140531-3178-4964-adf6-e1b8a1264276 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:58.410445 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a6140531-3178-4964-adf6-e1b8a1264276 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:58.418646 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a6140531-3178-4964-adf6-e1b8a1264276 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1362 microversion: 2.1 time: 0.256030 Sep 06 16:24:58.419232 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 522/1025] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:58 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:24:59.442101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e6298fe8-0445-4d09-86da-df1c2c859208 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:59.442905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e6298fe8-0445-4d09-86da-df1c2c859208 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:59.450010 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e6298fe8-0445-4d09-86da-df1c2c859208 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:59.450832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e6298fe8-0445-4d09-86da-df1c2c859208 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:59.451466 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e6298fe8-0445-4d09-86da-df1c2c859208 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:59.452517 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e6298fe8-0445-4d09-86da-df1c2c859208 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:59.453439 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e6298fe8-0445-4d09-86da-df1c2c859208 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:59.454027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e6298fe8-0445-4d09-86da-df1c2c859208 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:59.615493 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e6298fe8-0445-4d09-86da-df1c2c859208 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:59.625292 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e6298fe8-0445-4d09-86da-df1c2c859208 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1549 microversion: 2.1 time: 0.187147 Sep 06 16:24:59.626348 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 504/1026] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:59 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:59.652163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ad59c754-514c-45fe-ac13-1aa728477764 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:59.652725 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ad59c754-514c-45fe-ac13-1aa728477764 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:59.659335 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad59c754-514c-45fe-ac13-1aa728477764 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:59.660022 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad59c754-514c-45fe-ac13-1aa728477764 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:59.660447 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad59c754-514c-45fe-ac13-1aa728477764 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:59.661161 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad59c754-514c-45fe-ac13-1aa728477764 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:59.661773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad59c754-514c-45fe-ac13-1aa728477764 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:59.662189 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ad59c754-514c-45fe-ac13-1aa728477764 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:59.666148 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:59.812566 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ad59c754-514c-45fe-ac13-1aa728477764 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168022 Sep 06 16:24:59.813193 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 523/1027] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 6 16:24:59 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:01.082728 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-c6592f0a-1bf4-4f3e-850e-d5c47b252678 req-c590d8dd-df9a-4506-879e-cefd5974f36a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a39987c5-d718-40b4-804f-328144e58e8b", "tag": "d0c9b9f7-0d8c-4c96-8253-1d2ea33d8104"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:01.092488 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c6592f0a-1bf4-4f3e-850e-d5c47b252678 req-c590d8dd-df9a-4506-879e-cefd5974f36a service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:01.093074 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c6592f0a-1bf4-4f3e-850e-d5c47b252678 req-c590d8dd-df9a-4506-879e-cefd5974f36a service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:01.093563 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c6592f0a-1bf4-4f3e-850e-d5c47b252678 req-c590d8dd-df9a-4506-879e-cefd5974f36a service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:01.105070 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-c6592f0a-1bf4-4f3e-850e-d5c47b252678 req-c590d8dd-df9a-4506-879e-cefd5974f36a service nova] Creating event network-changed:d0c9b9f7-0d8c-4c96-8253-1d2ea33d8104 for instance a39987c5-d718-40b4-804f-328144e58e8b on hv-cinder-85221 Sep 06 16:25:01.110261 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-c6592f0a-1bf4-4f3e-850e-d5c47b252678 req-c590d8dd-df9a-4506-879e-cefd5974f36a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032338 Sep 06 16:25:01.110856 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 524/1028] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:01.182290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7bb50ddf-0fda-4031-9767-b571c65a53df tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Action: 'create', calling method: .version_select at 0x7f83e947a5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1471845851"}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:01.528221 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7bb50ddf-0fda-4031-9767-b571c65a53df tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.469106 Sep 06 16:25:01.528678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 505/1029] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Sep 6 16:25:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 470 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 16:25:01.554022 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5c607e97-be6e-43db-9a86-663e6acf0b28 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e943e280>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:01.624638 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5c607e97-be6e-43db-9a86-663e6acf0b28 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72" status: 200 len: 345 microversion: 2.1 time: 0.079051 Sep 06 16:25:01.625438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 525/1030] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:25:01 2022] GET /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72 => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:02.646653 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-23c5134d-9386-41ed-a8bd-ddfb930e9b09 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83ecca9c10>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:02.700244 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-23c5134d-9386-41ed-a8bd-ddfb930e9b09 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72" status: 200 len: 346 microversion: 2.1 time: 0.058423 Sep 06 16:25:02.701161 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 506/1031] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:25:02 2022] GET /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72 => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:02.723401 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0b56b49f-879f-4e7d-989f-4b5d2e5b68ec tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Action: 'create', calling method: .version_select at 0x7f83e94dc1f0>, body: {"snapshot": {"volume_id": "df8f9bf3-ccd2-4870-91d0-b9212dda0b72", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1524462985"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:02.891785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0b56b49f-879f-4e7d-989f-4b5d2e5b68ec tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.172801 Sep 06 16:25:02.892373 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 526/1032] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Sep 6 16:25:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:02.905129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e324942a-c614-4e8a-a77d-c868b23f9b22 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83ecca90d0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:02.939666 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e324942a-c614-4e8a-a77d-c868b23f9b22 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4" status: 200 len: 287 microversion: 2.1 time: 0.039464 Sep 06 16:25:02.940244 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 507/1033] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 6 16:25:02 2022] GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:02.951873 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-199ef31e-41bd-461a-a935-f2228978b1b7 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e94c6820>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:02.982956 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-199ef31e-41bd-461a-a935-f2228978b1b7 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035333 Sep 06 16:25:02.983525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 527/1034] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Sep 6 16:25:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:02.994998 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1450b518-46ad-49c2-b013-8e1f87a6046c tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e947a790>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:03.026438 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1450b518-46ad-49c2-b013-8e1f87a6046c tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4" status: 200 len: 287 microversion: 2.1 time: 0.035214 Sep 06 16:25:03.026978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 508/1035] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 6 16:25:02 2022] GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:04.040037 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-92d95dea-4a7e-4086-b2d0-b14ad8933d1e tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e943e3a0>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:04.072250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-92d95dea-4a7e-4086-b2d0-b14ad8933d1e tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4" status: 200 len: 287 microversion: 2.1 time: 0.036566 Sep 06 16:25:04.072830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 528/1036] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 6 16:25:04 2022] GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:05.088742 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a5f23e6f-8a03-43b0-a569-68193270408b tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e9459790>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:05.119367 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a5f23e6f-8a03-43b0-a569-68193270408b tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4" status: 200 len: 287 microversion: 2.1 time: 0.035845 Sep 06 16:25:05.119992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 509/1037] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 6 16:25:05 2022] GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:06.136160 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ce2b4254-5118-4674-8fb4-6f2b7b3f19b9 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e94a7820>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:06.168341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ce2b4254-5118-4674-8fb4-6f2b7b3f19b9 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4" status: 200 len: 287 microversion: 2.1 time: 0.038766 Sep 06 16:25:06.168904 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 529/1038] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 6 16:25:06 2022] GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:07.187755 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-151b19c6-83ba-4954-9543-031d188ae96d tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e9673e50>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:07.225945 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-151b19c6-83ba-4954-9543-031d188ae96d tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4" status: 200 len: 287 microversion: 2.1 time: 0.046534 Sep 06 16:25:07.226763 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 510/1039] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 6 16:25:07 2022] GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:08.245332 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-50691885-c9b4-44b3-bc1a-e63ae38bfaa3 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e950f160>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:08.279360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-50691885-c9b4-44b3-bc1a-e63ae38bfaa3 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4" status: 200 len: 288 microversion: 2.1 time: 0.041667 Sep 06 16:25:08.280105 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 530/1040] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 6 16:25:08 2022] GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4 => generated 288 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:08.292033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-aec8bd92-22ba-4c98-b9a8-757938d3a02a tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e970ddc0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:08.362915 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-aec8bd92-22ba-4c98-b9a8-757938d3a02a tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4" status: 202 len: 0 microversion: 2.1 time: 0.074888 Sep 06 16:25:08.363473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 511/1041] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Sep 6 16:25:08 2022] DELETE /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:25:08.372075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9b8d43b2-e279-4e09-9ef0-43e7aeb6851d tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e980c670>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:08.402501 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9b8d43b2-e279-4e09-9ef0-43e7aeb6851d tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4" status: 200 len: 287 microversion: 2.1 time: 0.034213 Sep 06 16:25:08.403231 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 531/1042] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 6 16:25:08 2022] GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:09.416997 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-dac98654-b680-42c7-89f6-5f354d48a199 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83ecca9430>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:09.445678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-dac98654-b680-42c7-89f6-5f354d48a199 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] HTTP exception thrown: Snapshot b9dd80b1-55d1-4911-af58-b6b1380689a4 could not be found. Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-dac98654-b680-42c7-89f6-5f354d48a199 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Request method failure captured: Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4 HTTP/1.1 Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3Rc_VTEUfm4BakVZt6LoXtehlQJYNbc6WR6D9Y0p8mw4Vn5mzMPK0cFHCppGHESuuj7enksHOPMWoWUJ-jhojlRclzyS83e0274niX1e1J8K6vxQuQrNY2AcXIiKC1ARZSJN1bgYsgx_UOg5TgySs4PYgiYdfIjaOnVcpJx1J_JIKQ Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 4b9d52517f2145b6ac1cf64831658783 Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2111709816 Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:25:09.448660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2111709816 Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 4b9d52517f2145b6ac1cf64831658783 Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2111709816 Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesSnapshotsTestJSON-2111709816-project Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: a1d69be709e647fbb3a85c447daa8f2a Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2111709816-project Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Snapshot b9dd80b1-55d1-4911-af58-b6b1380689a4 could not be found. Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'b9dd80b1-55d1-4911-af58-b6b1380689a4'} Sep 06 16:25:09.450268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b9dd80b1-55d1-4911-af58-b6b1380689a4 could not be found. (HTTP 404) (Request-ID: req-9aa72124-ca08-4c94-bb56-b18807da9999) Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:09.451226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:25:09.452482 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b9dd80b1-55d1-4911-af58-b6b1380689a4 could not be found. Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 06 16:25:09.453780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b9dd80b1-55d1-4911-af58-b6b1380689a4 could not be found. Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b9dd80b1-55d1-4911-af58-b6b1380689a4 could not be found. Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-dac98654-b680-42c7-89f6-5f354d48a199 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Returning 404 to user: Snapshot b9dd80b1-55d1-4911-af58-b6b1380689a4 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:25:09.455181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-dac98654-b680-42c7-89f6-5f354d48a199 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4" status: 404 len: 111 microversion: 2.1 time: 0.038109 Sep 06 16:25:09.456252 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 512/1043] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 6 16:25:09 2022] GET /compute/v2.1/os-snapshots/b9dd80b1-55d1-4911-af58-b6b1380689a4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:25:09.460297 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1f3ef5b0-fbc7-436b-adb5-72d7a44b543d tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e94f6790>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:09.529740 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1f3ef5b0-fbc7-436b-adb5-72d7a44b543d tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72" status: 202 len: 0 microversion: 2.1 time: 0.073717 Sep 06 16:25:09.530466 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 532/1044] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 6 16:25:09 2022] DELETE /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:25:09.538030 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=8 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:09.543008 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f50c8549-cb9f-48fe-9361-cb2ea3e5c142 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e970dee0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:09.599652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f50c8549-cb9f-48fe-9361-cb2ea3e5c142 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72" status: 200 len: 345 microversion: 2.1 time: 0.063257 Sep 06 16:25:09.600411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 513/1045] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:25:09 2022] GET /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:10.615971 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6363ce49-8259-4d3f-bcb4-4168b6ccf4a2 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e950f940>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:10.647150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-6363ce49-8259-4d3f-bcb4-4168b6ccf4a2 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] HTTP exception thrown: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6363ce49-8259-4d3f-bcb4-4168b6ccf4a2 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Request method failure captured: Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72 HTTP/1.1 Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3Rc_VTEUfm4BakVZt6LoXtehlQJYNbc6WR6D9Y0p8mw4Vn5mzMPK0cFHCppGHESuuj7enksHOPMWoWUJ-jhojlRclzyS83e0274niX1e1J8K6vxQuQrNY2AcXIiKC1ARZSJN1bgYsgx_UOg5TgySs4PYgiYdfIjaOnVcpJx1J_JIKQ Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 4b9d52517f2145b6ac1cf64831658783 Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2111709816 Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:25:10.650756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2111709816 Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 4b9d52517f2145b6ac1cf64831658783 Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2111709816 Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-VolumesSnapshotsTestJSON-2111709816-project Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: a1d69be709e647fbb3a85c447daa8f2a Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2111709816-project Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'df8f9bf3-ccd2-4870-91d0-b9212dda0b72'} Sep 06 16:25:10.652211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. (HTTP 404) (Request-ID: req-a480e4a3-9ac0-4568-85ce-5044a628c3d7) Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:10.653564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:25:10.654796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 16:25:10.655977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6363ce49-8259-4d3f-bcb4-4168b6ccf4a2 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Returning 404 to user: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6363ce49-8259-4d3f-bcb4-4168b6ccf4a2 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72" status: 404 len: 109 microversion: 2.1 time: 0.040845 Sep 06 16:25:10.657180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 533/1046] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:25:10 2022] GET /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:25:10.663457 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:10.668335 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c75a06a4-63aa-4729-af57-d51c724ddef4 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e9673700>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:10.698315 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-c75a06a4-63aa-4729-af57-d51c724ddef4 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] HTTP exception thrown: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c75a06a4-63aa-4729-af57-d51c724ddef4 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Request method failure captured: Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: DELETE /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72 HTTP/1.1 Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3Rc_VTEUfm4BakVZt6LoXtehlQJYNbc6WR6D9Y0p8mw4Vn5mzMPK0cFHCppGHESuuj7enksHOPMWoWUJ-jhojlRclzyS83e0274niX1e1J8K6vxQuQrNY2AcXIiKC1ARZSJN1bgYsgx_UOg5TgySs4PYgiYdfIjaOnVcpJx1J_JIKQ Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 4b9d52517f2145b6ac1cf64831658783 Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2111709816 Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:25:10.700281 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2111709816 Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 4b9d52517f2145b6ac1cf64831658783 Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2111709816 Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-VolumesSnapshotsTestJSON-2111709816-project Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: a1d69be709e647fbb3a85c447daa8f2a Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2111709816-project Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'df8f9bf3-ccd2-4870-91d0-b9212dda0b72'} Sep 06 16:25:10.701873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. (HTTP 404) (Request-ID: req-45193c2d-0c8b-4cb2-b5f4-e948a4a096fe) Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:10.702864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 16:25:10.704121 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 16:25:10.705313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c75a06a4-63aa-4729-af57-d51c724ddef4 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Returning 404 to user: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:25:10.706536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c75a06a4-63aa-4729-af57-d51c724ddef4 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72" status: 404 len: 109 microversion: 2.1 time: 0.039068 Sep 06 16:25:10.707371 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 514/1047] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 6 16:25:10 2022] DELETE /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 16:25:10.710684 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3e693c42-2bc1-4abb-9e99-48d78ff23b35 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Calling method '.version_select at 0x7f83e943e4c0>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:10.738349 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-3e693c42-2bc1-4abb-9e99-48d78ff23b35 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] HTTP exception thrown: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3e693c42-2bc1-4abb-9e99-48d78ff23b35 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Request method failure captured: Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72 HTTP/1.1 Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3Rc_VTEUfm4BakVZt6LoXtehlQJYNbc6WR6D9Y0p8mw4Vn5mzMPK0cFHCppGHESuuj7enksHOPMWoWUJ-jhojlRclzyS83e0274niX1e1J8K6vxQuQrNY2AcXIiKC1ARZSJN1bgYsgx_UOg5TgySs4PYgiYdfIjaOnVcpJx1J_JIKQ Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 4b9d52517f2145b6ac1cf64831658783 Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2111709816 Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:25:10.740309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b9d52517f2145b6ac1cf64831658783"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2111709816 Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 4b9d52517f2145b6ac1cf64831658783 Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2111709816 Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-VolumesSnapshotsTestJSON-2111709816-project Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: a1d69be709e647fbb3a85c447daa8f2a Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2111709816-project Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'df8f9bf3-ccd2-4870-91d0-b9212dda0b72'} Sep 06 16:25:10.741811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. (HTTP 404) (Request-ID: req-9a618955-f3d0-4bfe-8f97-1f5bd4c12611) Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:10.742656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:25:10.743838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 16:25:10.745063 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3e693c42-2bc1-4abb-9e99-48d78ff23b35 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] Returning 404 to user: Volume df8f9bf3-ccd2-4870-91d0-b9212dda0b72 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3e693c42-2bc1-4abb-9e99-48d78ff23b35 tempest-VolumesSnapshotsTestJSON-2111709816 tempest-VolumesSnapshotsTestJSON-2111709816-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72" status: 404 len: 109 microversion: 2.1 time: 0.035110 Sep 06 16:25:10.746219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 534/1048] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Sep 6 16:25:10 2022] GET /compute/v2.1/os-volumes/df8f9bf3-ccd2-4870-91d0-b9212dda0b72 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:25:11.829944 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fb650455-1c57-4e98-a14a-72c7e3ad8554 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:11.830543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fb650455-1c57-4e98-a14a-72c7e3ad8554 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:11.836849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb650455-1c57-4e98-a14a-72c7e3ad8554 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:11.837410 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb650455-1c57-4e98-a14a-72c7e3ad8554 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:11.837742 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb650455-1c57-4e98-a14a-72c7e3ad8554 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:11.838461 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb650455-1c57-4e98-a14a-72c7e3ad8554 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:11.838892 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb650455-1c57-4e98-a14a-72c7e3ad8554 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:11.839401 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb650455-1c57-4e98-a14a-72c7e3ad8554 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:11.864776 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fb650455-1c57-4e98-a14a-72c7e3ad8554 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/ips" status: 200 len: 151 microversion: 2.20 time: 0.038505 Sep 06 16:25:11.864776 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 515/1049] 10.222.0.43 () {60 vars in 1289 bytes} [Tue Sep 6 16:25:11 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:25:13.741753 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=18 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:13.742648 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=4 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:13.748272 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3f8d0449-3aab-4b3a-b2aa-078544d89046 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:13.748940 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3f8d0449-3aab-4b3a-b2aa-078544d89046 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:13.755848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3f8d0449-3aab-4b3a-b2aa-078544d89046 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:13.756323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3f8d0449-3aab-4b3a-b2aa-078544d89046 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:13.756813 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3f8d0449-3aab-4b3a-b2aa-078544d89046 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:13.757497 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3f8d0449-3aab-4b3a-b2aa-078544d89046 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:13.757939 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3f8d0449-3aab-4b3a-b2aa-078544d89046 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:13.758352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3f8d0449-3aab-4b3a-b2aa-078544d89046 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:13.782538 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-3f8d0449-3aab-4b3a-b2aa-078544d89046 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lazy-loading 'flavor' on Instance uuid 5393a1be-4392-48fb-b317-79525e0639b6 {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:25:13.978129 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3f8d0449-3aab-4b3a-b2aa-078544d89046 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "POST /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/action" status: 202 len: 0 microversion: 2.20 time: 0.237042 Sep 06 16:25:13.979050 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 535/1050] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Sep 6 16:25:13 2022] POST /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:25:13.987090 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-197a2f08-cca0-436c-8111-847df62063c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:13.987708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-197a2f08-cca0-436c-8111-847df62063c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:13.994807 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-197a2f08-cca0-436c-8111-847df62063c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:13.995326 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-197a2f08-cca0-436c-8111-847df62063c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:13.995828 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-197a2f08-cca0-436c-8111-847df62063c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:13.997064 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-197a2f08-cca0-436c-8111-847df62063c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:13.997606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-197a2f08-cca0-436c-8111-847df62063c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:13.998026 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-197a2f08-cca0-436c-8111-847df62063c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:14.178240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-197a2f08-cca0-436c-8111-847df62063c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:14.186902 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-197a2f08-cca0-436c-8111-847df62063c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:14.188536 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-197a2f08-cca0-436c-8111-847df62063c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:14.190114 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-197a2f08-cca0-436c-8111-847df62063c1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.207106 Sep 06 16:25:14.199486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 516/1051] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:13 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:15.217644 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a117716f-7cdb-4c89-aaf9-4dff7c26a656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:15.218340 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a117716f-7cdb-4c89-aaf9-4dff7c26a656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:15.225993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a117716f-7cdb-4c89-aaf9-4dff7c26a656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:15.226998 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a117716f-7cdb-4c89-aaf9-4dff7c26a656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:15.227427 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a117716f-7cdb-4c89-aaf9-4dff7c26a656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:15.228108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a117716f-7cdb-4c89-aaf9-4dff7c26a656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:15.228554 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a117716f-7cdb-4c89-aaf9-4dff7c26a656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:15.228987 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a117716f-7cdb-4c89-aaf9-4dff7c26a656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:15.362786 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a117716f-7cdb-4c89-aaf9-4dff7c26a656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:15.371569 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a117716f-7cdb-4c89-aaf9-4dff7c26a656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:15.373004 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a117716f-7cdb-4c89-aaf9-4dff7c26a656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:15.374183 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a117716f-7cdb-4c89-aaf9-4dff7c26a656 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.161493 Sep 06 16:25:15.374743 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 536/1052] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:15 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:16.399756 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-788880a9-7e0b-4071-b78d-208487cbe858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:16.400302 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-788880a9-7e0b-4071-b78d-208487cbe858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:16.407787 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-788880a9-7e0b-4071-b78d-208487cbe858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:16.408273 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-788880a9-7e0b-4071-b78d-208487cbe858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:16.408717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-788880a9-7e0b-4071-b78d-208487cbe858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:16.409445 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-788880a9-7e0b-4071-b78d-208487cbe858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:16.409898 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-788880a9-7e0b-4071-b78d-208487cbe858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:16.410325 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-788880a9-7e0b-4071-b78d-208487cbe858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:16.540081 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-788880a9-7e0b-4071-b78d-208487cbe858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:16.548664 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-788880a9-7e0b-4071-b78d-208487cbe858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:16.550202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-788880a9-7e0b-4071-b78d-208487cbe858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:16.551364 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-788880a9-7e0b-4071-b78d-208487cbe858 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.155782 Sep 06 16:25:16.551904 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 517/1053] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:16 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:17.582222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-86cb0910-1de1-42b9-8b69-73eee44fc3c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:17.583212 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-86cb0910-1de1-42b9-8b69-73eee44fc3c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:17.591760 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-86cb0910-1de1-42b9-8b69-73eee44fc3c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:17.592229 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-86cb0910-1de1-42b9-8b69-73eee44fc3c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:17.592657 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-86cb0910-1de1-42b9-8b69-73eee44fc3c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:17.593368 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-86cb0910-1de1-42b9-8b69-73eee44fc3c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:17.593814 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-86cb0910-1de1-42b9-8b69-73eee44fc3c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:17.594228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-86cb0910-1de1-42b9-8b69-73eee44fc3c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:17.737352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-86cb0910-1de1-42b9-8b69-73eee44fc3c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:17.746052 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-86cb0910-1de1-42b9-8b69-73eee44fc3c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:17.747490 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-86cb0910-1de1-42b9-8b69-73eee44fc3c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:17.748651 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-86cb0910-1de1-42b9-8b69-73eee44fc3c3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.173053 Sep 06 16:25:17.749229 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 537/1054] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:17 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:18.778446 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9457cdeb-f4b0-443d-99c5-07b47331625c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:18.779448 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9457cdeb-f4b0-443d-99c5-07b47331625c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:18.790713 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9457cdeb-f4b0-443d-99c5-07b47331625c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:18.791192 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9457cdeb-f4b0-443d-99c5-07b47331625c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:18.791628 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9457cdeb-f4b0-443d-99c5-07b47331625c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:18.792315 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9457cdeb-f4b0-443d-99c5-07b47331625c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:18.792795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9457cdeb-f4b0-443d-99c5-07b47331625c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:18.793237 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9457cdeb-f4b0-443d-99c5-07b47331625c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:18.933042 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9457cdeb-f4b0-443d-99c5-07b47331625c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:18.945571 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9457cdeb-f4b0-443d-99c5-07b47331625c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:18.947553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9457cdeb-f4b0-443d-99c5-07b47331625c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:18.948711 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9457cdeb-f4b0-443d-99c5-07b47331625c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.176901 Sep 06 16:25:18.949296 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 518/1055] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:18 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:19.975926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-205436b8-7fcc-4dbf-96ef-f4247cfaeb61 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:19.976628 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-205436b8-7fcc-4dbf-96ef-f4247cfaeb61 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:19.984684 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-205436b8-7fcc-4dbf-96ef-f4247cfaeb61 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:19.985319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-205436b8-7fcc-4dbf-96ef-f4247cfaeb61 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:19.985921 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-205436b8-7fcc-4dbf-96ef-f4247cfaeb61 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:19.986880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-205436b8-7fcc-4dbf-96ef-f4247cfaeb61 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:19.987433 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-205436b8-7fcc-4dbf-96ef-f4247cfaeb61 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:19.987926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-205436b8-7fcc-4dbf-96ef-f4247cfaeb61 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:20.121410 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-205436b8-7fcc-4dbf-96ef-f4247cfaeb61 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:20.130186 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-205436b8-7fcc-4dbf-96ef-f4247cfaeb61 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:20.131601 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-205436b8-7fcc-4dbf-96ef-f4247cfaeb61 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:20.132783 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-205436b8-7fcc-4dbf-96ef-f4247cfaeb61 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.161770 Sep 06 16:25:20.133340 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 538/1056] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:19 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:21.158022 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-afc9af4f-ddba-4916-9c1e-747b2be03bb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:21.158615 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-afc9af4f-ddba-4916-9c1e-747b2be03bb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:21.165195 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-afc9af4f-ddba-4916-9c1e-747b2be03bb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:21.165768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-afc9af4f-ddba-4916-9c1e-747b2be03bb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:21.166188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-afc9af4f-ddba-4916-9c1e-747b2be03bb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:21.166905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-afc9af4f-ddba-4916-9c1e-747b2be03bb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:21.167358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-afc9af4f-ddba-4916-9c1e-747b2be03bb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:21.167740 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-afc9af4f-ddba-4916-9c1e-747b2be03bb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:21.311559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-afc9af4f-ddba-4916-9c1e-747b2be03bb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:21.320357 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-afc9af4f-ddba-4916-9c1e-747b2be03bb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:21.322232 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-afc9af4f-ddba-4916-9c1e-747b2be03bb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:21.323418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-afc9af4f-ddba-4916-9c1e-747b2be03bb5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.169469 Sep 06 16:25:21.324328 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 519/1057] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:21 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:22.352789 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6394b838-a360-4767-917c-8cf2dab81c58 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:22.353707 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6394b838-a360-4767-917c-8cf2dab81c58 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:22.364561 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6394b838-a360-4767-917c-8cf2dab81c58 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:22.365404 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6394b838-a360-4767-917c-8cf2dab81c58 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:22.366128 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6394b838-a360-4767-917c-8cf2dab81c58 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:22.367247 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6394b838-a360-4767-917c-8cf2dab81c58 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:22.367992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6394b838-a360-4767-917c-8cf2dab81c58 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:22.368685 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6394b838-a360-4767-917c-8cf2dab81c58 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:22.506422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6394b838-a360-4767-917c-8cf2dab81c58 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:22.518279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6394b838-a360-4767-917c-8cf2dab81c58 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:22.519711 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6394b838-a360-4767-917c-8cf2dab81c58 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:22.520929 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6394b838-a360-4767-917c-8cf2dab81c58 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.174776 Sep 06 16:25:22.521490 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 539/1058] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:22 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:23.546839 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8847363b-44d6-4e52-a915-17530570edcd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:23.547345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8847363b-44d6-4e52-a915-17530570edcd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:23.554554 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8847363b-44d6-4e52-a915-17530570edcd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:23.555036 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8847363b-44d6-4e52-a915-17530570edcd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:23.555474 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8847363b-44d6-4e52-a915-17530570edcd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:23.556165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8847363b-44d6-4e52-a915-17530570edcd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:23.556621 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8847363b-44d6-4e52-a915-17530570edcd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:23.557134 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8847363b-44d6-4e52-a915-17530570edcd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:23.694768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8847363b-44d6-4e52-a915-17530570edcd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:23.703371 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8847363b-44d6-4e52-a915-17530570edcd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:23.704801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8847363b-44d6-4e52-a915-17530570edcd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:23.705995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8847363b-44d6-4e52-a915-17530570edcd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.163287 Sep 06 16:25:23.706553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 520/1059] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:23 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:24.735795 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-dd107f51-234a-4b7c-8558-6dbd815c265b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:24.736960 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-dd107f51-234a-4b7c-8558-6dbd815c265b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:24.747402 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dd107f51-234a-4b7c-8558-6dbd815c265b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:24.747883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dd107f51-234a-4b7c-8558-6dbd815c265b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:24.748318 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dd107f51-234a-4b7c-8558-6dbd815c265b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:24.749043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dd107f51-234a-4b7c-8558-6dbd815c265b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:24.749499 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dd107f51-234a-4b7c-8558-6dbd815c265b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:24.749917 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dd107f51-234a-4b7c-8558-6dbd815c265b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:24.889993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dd107f51-234a-4b7c-8558-6dbd815c265b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:24.902335 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dd107f51-234a-4b7c-8558-6dbd815c265b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:24.904077 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dd107f51-234a-4b7c-8558-6dbd815c265b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:24.905241 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-dd107f51-234a-4b7c-8558-6dbd815c265b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.176321 Sep 06 16:25:24.905812 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 540/1060] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:24 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:25.931521 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cf4fcb5c-e1c4-43c6-948c-c270eeb2fe82 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:25.932049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cf4fcb5c-e1c4-43c6-948c-c270eeb2fe82 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:25.939832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cf4fcb5c-e1c4-43c6-948c-c270eeb2fe82 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:25.940314 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cf4fcb5c-e1c4-43c6-948c-c270eeb2fe82 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:25.940739 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cf4fcb5c-e1c4-43c6-948c-c270eeb2fe82 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:25.941477 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cf4fcb5c-e1c4-43c6-948c-c270eeb2fe82 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:25.941931 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cf4fcb5c-e1c4-43c6-948c-c270eeb2fe82 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:25.942603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cf4fcb5c-e1c4-43c6-948c-c270eeb2fe82 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:26.072436 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b819df12-b898-4b21-bf36-85272465fee6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:26.076305 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cf4fcb5c-e1c4-43c6-948c-c270eeb2fe82 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:26.080182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b819df12-b898-4b21-bf36-85272465fee6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:26.088916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cf4fcb5c-e1c4-43c6-948c-c270eeb2fe82 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:26.090498 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cf4fcb5c-e1c4-43c6-948c-c270eeb2fe82 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:26.091668 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cf4fcb5c-e1c4-43c6-948c-c270eeb2fe82 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.164707 Sep 06 16:25:26.092349 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b819df12-b898-4b21-bf36-85272465fee6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:26.104900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 521/1061] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:25 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:26.105637 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b819df12-b898-4b21-bf36-85272465fee6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:26.106138 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b819df12-b898-4b21-bf36-85272465fee6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:26.106856 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b819df12-b898-4b21-bf36-85272465fee6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:26.107403 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b819df12-b898-4b21-bf36-85272465fee6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:26.107819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b819df12-b898-4b21-bf36-85272465fee6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:26.134195 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b819df12-b898-4b21-bf36-85272465fee6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Going to try to terminate instance {{(pid=120668) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:25:26.212889 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b819df12-b898-4b21-bf36-85272465fee6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 204 len: 0 microversion: 2.1 time: 0.145410 Sep 06 16:25:26.213900 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 541/1062] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:25:26 2022] DELETE /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 16:25:26.223769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fb503c28-0897-413b-8489-216bfe231ad6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:26.224377 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fb503c28-0897-413b-8489-216bfe231ad6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:26.230321 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb503c28-0897-413b-8489-216bfe231ad6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:26.230813 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb503c28-0897-413b-8489-216bfe231ad6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:26.231218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb503c28-0897-413b-8489-216bfe231ad6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:26.232019 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb503c28-0897-413b-8489-216bfe231ad6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:26.232466 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb503c28-0897-413b-8489-216bfe231ad6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:26.232913 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb503c28-0897-413b-8489-216bfe231ad6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:26.377515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fb503c28-0897-413b-8489-216bfe231ad6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:26.385963 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fb503c28-0897-413b-8489-216bfe231ad6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1578 microversion: 2.1 time: 0.166525 Sep 06 16:25:26.386627 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 522/1063] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:26 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:25:27.123967 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2325cab1-4fae-4b32-a569-ac6bc563ae99 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:27.124664 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2325cab1-4fae-4b32-a569-ac6bc563ae99 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:27.131476 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2325cab1-4fae-4b32-a569-ac6bc563ae99 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:27.131950 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2325cab1-4fae-4b32-a569-ac6bc563ae99 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:27.132373 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2325cab1-4fae-4b32-a569-ac6bc563ae99 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:27.133082 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2325cab1-4fae-4b32-a569-ac6bc563ae99 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:27.133525 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2325cab1-4fae-4b32-a569-ac6bc563ae99 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:27.133935 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2325cab1-4fae-4b32-a569-ac6bc563ae99 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:27.270949 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2325cab1-4fae-4b32-a569-ac6bc563ae99 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:27.280220 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2325cab1-4fae-4b32-a569-ac6bc563ae99 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:27.281758 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2325cab1-4fae-4b32-a569-ac6bc563ae99 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:27.282993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2325cab1-4fae-4b32-a569-ac6bc563ae99 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.163347 Sep 06 16:25:27.283624 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 542/1064] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:27 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:27.409781 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7ec3a702-6b10-48cc-b6e2-f0360cc475df tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:27.410365 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7ec3a702-6b10-48cc-b6e2-f0360cc475df tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:27.417183 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ec3a702-6b10-48cc-b6e2-f0360cc475df tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:27.417650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ec3a702-6b10-48cc-b6e2-f0360cc475df tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:27.418078 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ec3a702-6b10-48cc-b6e2-f0360cc475df tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:27.418773 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ec3a702-6b10-48cc-b6e2-f0360cc475df tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:27.419299 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ec3a702-6b10-48cc-b6e2-f0360cc475df tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:27.419730 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ec3a702-6b10-48cc-b6e2-f0360cc475df tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:27.634758 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7ec3a702-6b10-48cc-b6e2-f0360cc475df tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:27.642967 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7ec3a702-6b10-48cc-b6e2-f0360cc475df tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1578 microversion: 2.1 time: 0.237135 Sep 06 16:25:27.643580 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 523/1065] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:27 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1578 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:28.308157 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f304c452-e141-4772-8d21-a183c2dcfe13 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:28.308841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f304c452-e141-4772-8d21-a183c2dcfe13 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:28.315323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f304c452-e141-4772-8d21-a183c2dcfe13 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:28.315798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f304c452-e141-4772-8d21-a183c2dcfe13 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:28.316222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f304c452-e141-4772-8d21-a183c2dcfe13 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:28.316952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f304c452-e141-4772-8d21-a183c2dcfe13 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:28.317391 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f304c452-e141-4772-8d21-a183c2dcfe13 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:28.317809 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f304c452-e141-4772-8d21-a183c2dcfe13 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:28.456050 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f304c452-e141-4772-8d21-a183c2dcfe13 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:28.468135 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f304c452-e141-4772-8d21-a183c2dcfe13 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:28.469612 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f304c452-e141-4772-8d21-a183c2dcfe13 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:28.470793 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f304c452-e141-4772-8d21-a183c2dcfe13 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.166562 Sep 06 16:25:28.471347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 543/1066] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:28 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:28.669351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6c6bb8a1-e39b-4048-8024-9777c20fd859 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:28.670053 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6c6bb8a1-e39b-4048-8024-9777c20fd859 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:28.676338 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6c6bb8a1-e39b-4048-8024-9777c20fd859 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:28.677068 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6c6bb8a1-e39b-4048-8024-9777c20fd859 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:28.677904 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6c6bb8a1-e39b-4048-8024-9777c20fd859 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:28.678947 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6c6bb8a1-e39b-4048-8024-9777c20fd859 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:28.679448 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6c6bb8a1-e39b-4048-8024-9777c20fd859 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:28.679940 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6c6bb8a1-e39b-4048-8024-9777c20fd859 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:28.883615 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6c6bb8a1-e39b-4048-8024-9777c20fd859 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:28.893568 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6c6bb8a1-e39b-4048-8024-9777c20fd859 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1578 microversion: 2.1 time: 0.229968 Sep 06 16:25:28.905650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 524/1067] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:28 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:29.492048 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-f308ecae-a866-4cc6-84c0-a3fe8d7f5049 req-03d141ed-9d7c-495d-aef9-21df2fa1c079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0542e187-d122-46db-bece-5aa1b888806a", "name": "network-vif-deleted", "tag": "c7b5df75-8cd5-4802-8bc1-339b184f46df"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:29.496415 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ec2da213-b697-4ffa-a11b-4947d5af70ba tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:29.497118 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ec2da213-b697-4ffa-a11b-4947d5af70ba tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:29.505228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-f308ecae-a866-4cc6-84c0-a3fe8d7f5049 req-03d141ed-9d7c-495d-aef9-21df2fa1c079 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:29.506128 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-f308ecae-a866-4cc6-84c0-a3fe8d7f5049 req-03d141ed-9d7c-495d-aef9-21df2fa1c079 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:29.506798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-f308ecae-a866-4cc6-84c0-a3fe8d7f5049 req-03d141ed-9d7c-495d-aef9-21df2fa1c079 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:29.507151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ec2da213-b697-4ffa-a11b-4947d5af70ba tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:29.507707 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ec2da213-b697-4ffa-a11b-4947d5af70ba tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:29.508262 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ec2da213-b697-4ffa-a11b-4947d5af70ba tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:29.509408 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ec2da213-b697-4ffa-a11b-4947d5af70ba tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:29.510209 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ec2da213-b697-4ffa-a11b-4947d5af70ba tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:29.510854 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ec2da213-b697-4ffa-a11b-4947d5af70ba tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:29.521587 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-f308ecae-a866-4cc6-84c0-a3fe8d7f5049 req-03d141ed-9d7c-495d-aef9-21df2fa1c079 service nova] Creating event network-vif-deleted:c7b5df75-8cd5-4802-8bc1-339b184f46df for instance 0542e187-d122-46db-bece-5aa1b888806a on hv-cinder-85221 Sep 06 16:25:29.526906 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-f308ecae-a866-4cc6-84c0-a3fe8d7f5049 req-03d141ed-9d7c-495d-aef9-21df2fa1c079 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039289 Sep 06 16:25:29.529656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 544/1068] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:29.665481 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ec2da213-b697-4ffa-a11b-4947d5af70ba tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:29.675657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ec2da213-b697-4ffa-a11b-4947d5af70ba tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:29.678194 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ec2da213-b697-4ffa-a11b-4947d5af70ba tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:29.679539 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ec2da213-b697-4ffa-a11b-4947d5af70ba tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.187926 Sep 06 16:25:29.680622 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 525/1069] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:29 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:29.928516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-04eb5c69-d2d4-4298-859a-339236f37226 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:29.929246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-04eb5c69-d2d4-4298-859a-339236f37226 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:29.941148 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04eb5c69-d2d4-4298-859a-339236f37226 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:29.941730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04eb5c69-d2d4-4298-859a-339236f37226 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:29.942496 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04eb5c69-d2d4-4298-859a-339236f37226 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:29.943269 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04eb5c69-d2d4-4298-859a-339236f37226 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:29.943816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04eb5c69-d2d4-4298-859a-339236f37226 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:29.944330 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04eb5c69-d2d4-4298-859a-339236f37226 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:30.022227 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-04eb5c69-d2d4-4298-859a-339236f37226 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:30.030673 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-04eb5c69-d2d4-4298-859a-339236f37226 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 200 len: 1225 microversion: 2.1 time: 0.117019 Sep 06 16:25:30.045542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 545/1070] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:29 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:30.708025 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-bf2993d4-cc87-4007-b0fd-64a78973307f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:30.708867 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-bf2993d4-cc87-4007-b0fd-64a78973307f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:30.716457 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bf2993d4-cc87-4007-b0fd-64a78973307f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:30.717193 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bf2993d4-cc87-4007-b0fd-64a78973307f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:30.717654 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bf2993d4-cc87-4007-b0fd-64a78973307f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:30.718511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bf2993d4-cc87-4007-b0fd-64a78973307f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:30.718896 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bf2993d4-cc87-4007-b0fd-64a78973307f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:30.719314 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bf2993d4-cc87-4007-b0fd-64a78973307f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:30.860173 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-bf2993d4-cc87-4007-b0fd-64a78973307f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:30.868789 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-bf2993d4-cc87-4007-b0fd-64a78973307f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:30.870260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-bf2993d4-cc87-4007-b0fd-64a78973307f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:30.871569 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-bf2993d4-cc87-4007-b0fd-64a78973307f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1744 microversion: 2.20 time: 0.167462 Sep 06 16:25:30.871974 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 526/1071] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:30 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:31.059739 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-47063da0-c8d4-4586-a37f-208657bd5b65 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:31.060973 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-47063da0-c8d4-4586-a37f-208657bd5b65 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:31.071712 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-47063da0-c8d4-4586-a37f-208657bd5b65 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:31.072500 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-47063da0-c8d4-4586-a37f-208657bd5b65 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:31.073249 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-47063da0-c8d4-4586-a37f-208657bd5b65 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:31.074380 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-47063da0-c8d4-4586-a37f-208657bd5b65 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:31.075127 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-47063da0-c8d4-4586-a37f-208657bd5b65 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:31.075866 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-47063da0-c8d4-4586-a37f-208657bd5b65 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:31.090730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-47063da0-c8d4-4586-a37f-208657bd5b65 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] HTTP exception thrown: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-47063da0-c8d4-4586-a37f-208657bd5b65 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Request method failure captured: Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a HTTP/1.1 Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3OiREQhTG9B-Q5aJkgP_rWhBDmzhNdyLx85uYcI2ePpI7dxK2qnue3q-QjISF-nlPJ_d8kmIRxLHMIbMKZsWH6UVwgIAGqR0bY5zS2cwoHKxroF1RVviH1F8KmDGnug0G94yeQRTcLzdRp8JocDNPG4asAAfN2TUUI68gRXtv1Tcqs Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: f90ec559752b44b2b67c765488814865 Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:25:31.092424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:25:31.094222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f90ec559752b44b2b67c765488814865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f90ec559752b44b2b67c765488814865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f90ec559752b44b2b67c765488814865"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f90ec559752b44b2b67c765488814865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:25:31.094222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:25:31.094222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: f90ec559752b44b2b67c765488814865 Sep 06 16:25:31.094222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:25:31.094222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-TestVolumeBootPattern-1496949111-project Sep 06 16:25:31.094222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:25:31.094222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:25:31.094222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 4d3856b7bb7f4f5bb801952b893bbe35 Sep 06 16:25:31.094222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-TestVolumeBootPattern-1496949111-project Sep 06 16:25:31.094222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:25:31.094222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:25:31.094222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': '0542e187-d122-46db-bece-5aa1b888806a'} Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:25:31.095250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:25:31.097026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:25:31.098524 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-47063da0-c8d4-4586-a37f-208657bd5b65 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Returning 404 to user: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:25:31.098524 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-47063da0-c8d4-4586-a37f-208657bd5b65 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 404 len: 111 microversion: 2.1 time: 0.042058 Sep 06 16:25:31.098524 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 546/1072] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:31 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:25:31.193793 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2118798423", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-923325397", "security_groups": [{"name": "tempest-secgroup-smoke-1499775823"}], "block_device_mapping_v2": [{"uuid": "ddd31293-7575-4bd5-8988-e969b145bb1b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9a45d73a-863f-4a67-b2f9-bb887da40d25"}]}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:31.313783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] validate_networks() for [('9a45d73a-863f-4a67-b2f9-bb887da40d25', None, None, None, None, None)] {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:25:31.686085 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:25:31.686586 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:25:31.687062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:25:31.687491 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:25:31.687901 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:25:31.696956 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:31.697452 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:31.697878 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:31.698599 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:31.699049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:31.699468 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:31.717283 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Getting quotas for project f90ec559752b44b2b67c765488814865. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:25:31.721465 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Getting quotas for user 4d3856b7bb7f4f5bb801952b893bbe35 and project f90ec559752b44b2b67c765488814865. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:25:31.779454 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:25:31.781659 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddd31293-7575-4bd5-8988-e969b145bb1b',volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:25:31.898813 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3a71c527-06db-4519-b344-847057803183 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:31.900031 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3a71c527-06db-4519-b344-847057803183 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:31.906483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3a71c527-06db-4519-b344-847057803183 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:31.907022 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3a71c527-06db-4519-b344-847057803183 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:31.907469 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3a71c527-06db-4519-b344-847057803183 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:31.908224 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3a71c527-06db-4519-b344-847057803183 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:31.908714 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3a71c527-06db-4519-b344-847057803183 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:31.909176 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3a71c527-06db-4519-b344-847057803183 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:31.924712 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-63a09010-c207-407e-9520-4a8caf4fddf9 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.734911 Sep 06 16:25:31.925410 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 527/1073] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:25:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:25:31.938401 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c860500b-c65d-4f36-880b-545e17471665 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:31.939054 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c860500b-c65d-4f36-880b-545e17471665 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:31.995218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c860500b-c65d-4f36-880b-545e17471665 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:32.002717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c860500b-c65d-4f36-880b-545e17471665 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1094 microversion: 2.1 time: 0.068832 Sep 06 16:25:32.003634 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 528/1074] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:31 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:32.054998 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3a71c527-06db-4519-b344-847057803183 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:32.063462 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3a71c527-06db-4519-b344-847057803183 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:32.064979 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3a71c527-06db-4519-b344-847057803183 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:32.066843 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3a71c527-06db-4519-b344-847057803183 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1744 microversion: 2.20 time: 0.172379 Sep 06 16:25:32.067404 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 547/1075] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:31 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:25:33.025702 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-93363ae8-dfb0-4825-b55a-f39746f3cbf5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:33.026327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-93363ae8-dfb0-4825-b55a-f39746f3cbf5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:33.035665 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-93363ae8-dfb0-4825-b55a-f39746f3cbf5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:33.036151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-93363ae8-dfb0-4825-b55a-f39746f3cbf5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:33.036572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-93363ae8-dfb0-4825-b55a-f39746f3cbf5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:33.037358 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-93363ae8-dfb0-4825-b55a-f39746f3cbf5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:33.037797 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-93363ae8-dfb0-4825-b55a-f39746f3cbf5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:33.038223 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-93363ae8-dfb0-4825-b55a-f39746f3cbf5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:33.093775 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c7d279ae-1a92-499c-8e09-0f2c6ee0fcde tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:33.094392 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c7d279ae-1a92-499c-8e09-0f2c6ee0fcde tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:33.101312 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c7d279ae-1a92-499c-8e09-0f2c6ee0fcde tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:33.104854 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-93363ae8-dfb0-4825-b55a-f39746f3cbf5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:33.109237 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c7d279ae-1a92-499c-8e09-0f2c6ee0fcde tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:33.109749 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c7d279ae-1a92-499c-8e09-0f2c6ee0fcde tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:33.110742 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c7d279ae-1a92-499c-8e09-0f2c6ee0fcde tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:33.111563 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c7d279ae-1a92-499c-8e09-0f2c6ee0fcde tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:33.112116 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c7d279ae-1a92-499c-8e09-0f2c6ee0fcde tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:33.121233 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-93363ae8-dfb0-4825-b55a-f39746f3cbf5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1192 microversion: 2.1 time: 0.099414 Sep 06 16:25:33.121853 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 529/1076] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:33 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1192 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:33.266923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c7d279ae-1a92-499c-8e09-0f2c6ee0fcde tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:33.276229 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c7d279ae-1a92-499c-8e09-0f2c6ee0fcde tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:33.277659 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c7d279ae-1a92-499c-8e09-0f2c6ee0fcde tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:33.278894 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c7d279ae-1a92-499c-8e09-0f2c6ee0fcde tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1744 microversion: 2.20 time: 0.190300 Sep 06 16:25:33.279498 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 548/1077] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:33 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1744 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:34.145098 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ce1f5f85-fc86-402f-8f12-7b6791005ab3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:34.146067 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ce1f5f85-fc86-402f-8f12-7b6791005ab3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:34.153104 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ce1f5f85-fc86-402f-8f12-7b6791005ab3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:34.153770 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ce1f5f85-fc86-402f-8f12-7b6791005ab3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:34.154286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ce1f5f85-fc86-402f-8f12-7b6791005ab3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:34.155842 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ce1f5f85-fc86-402f-8f12-7b6791005ab3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:34.156620 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ce1f5f85-fc86-402f-8f12-7b6791005ab3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:34.157258 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ce1f5f85-fc86-402f-8f12-7b6791005ab3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:34.275488 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-a88db5c0-b2cf-4651-8826-0255bafc95d6 req-a6aaa707-1a49-4355-8f07-05adcc180261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5393a1be-4392-48fb-b317-79525e0639b6", "name": "network-vif-plugged", "status": "completed", "tag": "871e4881-cbaf-4c42-8c18-28566def207e"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:34.286287 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a88db5c0-b2cf-4651-8826-0255bafc95d6 req-a6aaa707-1a49-4355-8f07-05adcc180261 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:34.286812 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a88db5c0-b2cf-4651-8826-0255bafc95d6 req-a6aaa707-1a49-4355-8f07-05adcc180261 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:34.287202 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a88db5c0-b2cf-4651-8826-0255bafc95d6 req-a6aaa707-1a49-4355-8f07-05adcc180261 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:34.292021 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:34.300787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-a88db5c0-b2cf-4651-8826-0255bafc95d6 req-a6aaa707-1a49-4355-8f07-05adcc180261 service nova] Creating event network-vif-plugged:871e4881-cbaf-4c42-8c18-28566def207e for instance 5393a1be-4392-48fb-b317-79525e0639b6 on hv-cinder-85221 Sep 06 16:25:34.306359 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-a88db5c0-b2cf-4651-8826-0255bafc95d6 req-a6aaa707-1a49-4355-8f07-05adcc180261 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034747 Sep 06 16:25:34.307120 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 549/1078] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:25:34.312810 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-85405f88-52be-47b8-bc59-65fe8d49d311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:34.313507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-85405f88-52be-47b8-bc59-65fe8d49d311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:34.320838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85405f88-52be-47b8-bc59-65fe8d49d311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:34.321279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85405f88-52be-47b8-bc59-65fe8d49d311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:34.321694 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85405f88-52be-47b8-bc59-65fe8d49d311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:34.322398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85405f88-52be-47b8-bc59-65fe8d49d311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:34.322844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85405f88-52be-47b8-bc59-65fe8d49d311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:34.323252 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-85405f88-52be-47b8-bc59-65fe8d49d311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:34.464738 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-85405f88-52be-47b8-bc59-65fe8d49d311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:34.474513 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-85405f88-52be-47b8-bc59-65fe8d49d311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:34.476109 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-85405f88-52be-47b8-bc59-65fe8d49d311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:34.477323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-85405f88-52be-47b8-bc59-65fe8d49d311 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1744 microversion: 2.20 time: 0.168838 Sep 06 16:25:34.477893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 550/1079] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:34 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:34.603273 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ce1f5f85-fc86-402f-8f12-7b6791005ab3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:34.611592 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ce1f5f85-fc86-402f-8f12-7b6791005ab3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1278 microversion: 2.1 time: 0.470707 Sep 06 16:25:34.612153 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 530/1080] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:34 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1278 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:35.021600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-a49ce19e-d30a-468a-b279-6402778f8c59 req-142f13f7-a79f-414e-a943-d84124d7fe62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9288c862-6167-4869-98a5-8121505ea169", "tag": "791df2dc-93bb-4c44-8f32-337aa6fcd193"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:35.034640 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a49ce19e-d30a-468a-b279-6402778f8c59 req-142f13f7-a79f-414e-a943-d84124d7fe62 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:35.035488 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a49ce19e-d30a-468a-b279-6402778f8c59 req-142f13f7-a79f-414e-a943-d84124d7fe62 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:35.036266 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a49ce19e-d30a-468a-b279-6402778f8c59 req-142f13f7-a79f-414e-a943-d84124d7fe62 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:35.055999 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-a49ce19e-d30a-468a-b279-6402778f8c59 req-142f13f7-a79f-414e-a943-d84124d7fe62 service nova] Creating event network-changed:791df2dc-93bb-4c44-8f32-337aa6fcd193 for instance 9288c862-6167-4869-98a5-8121505ea169 on hv-cinder-85221 Sep 06 16:25:35.061719 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-a49ce19e-d30a-468a-b279-6402778f8c59 req-142f13f7-a79f-414e-a943-d84124d7fe62 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045359 Sep 06 16:25:35.062312 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 551/1081] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:25:35.504425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fe4c2aae-ca1f-4c2e-9282-0cd6df7e497c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:35.505168 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fe4c2aae-ca1f-4c2e-9282-0cd6df7e497c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:35.512600 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fe4c2aae-ca1f-4c2e-9282-0cd6df7e497c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:35.513154 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fe4c2aae-ca1f-4c2e-9282-0cd6df7e497c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:35.513600 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fe4c2aae-ca1f-4c2e-9282-0cd6df7e497c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:35.514403 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fe4c2aae-ca1f-4c2e-9282-0cd6df7e497c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:35.514982 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fe4c2aae-ca1f-4c2e-9282-0cd6df7e497c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:35.515435 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fe4c2aae-ca1f-4c2e-9282-0cd6df7e497c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:35.636240 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f0cee81e-87f7-4ad5-ba9a-5cc5c699bc45 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:35.636989 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f0cee81e-87f7-4ad5-ba9a-5cc5c699bc45 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:35.644694 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f0cee81e-87f7-4ad5-ba9a-5cc5c699bc45 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:35.645216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f0cee81e-87f7-4ad5-ba9a-5cc5c699bc45 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:35.645640 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f0cee81e-87f7-4ad5-ba9a-5cc5c699bc45 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:35.646337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f0cee81e-87f7-4ad5-ba9a-5cc5c699bc45 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:35.646784 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f0cee81e-87f7-4ad5-ba9a-5cc5c699bc45 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:35.647202 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f0cee81e-87f7-4ad5-ba9a-5cc5c699bc45 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:35.686757 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fe4c2aae-ca1f-4c2e-9282-0cd6df7e497c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:35.695724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fe4c2aae-ca1f-4c2e-9282-0cd6df7e497c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:35.697399 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fe4c2aae-ca1f-4c2e-9282-0cd6df7e497c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:35.698671 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fe4c2aae-ca1f-4c2e-9282-0cd6df7e497c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1744 microversion: 2.20 time: 0.198670 Sep 06 16:25:35.699312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 531/1082] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:35 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1744 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:35.785228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f0cee81e-87f7-4ad5-ba9a-5cc5c699bc45 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:35.793469 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f0cee81e-87f7-4ad5-ba9a-5cc5c699bc45 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.161741 Sep 06 16:25:35.794112 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 552/1083] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:35 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:36.729617 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-95555a19-3647-4516-822a-d5be05161d87 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:36.730360 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-95555a19-3647-4516-822a-d5be05161d87 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:36.739898 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-95555a19-3647-4516-822a-d5be05161d87 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:36.740586 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-95555a19-3647-4516-822a-d5be05161d87 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:36.741240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-95555a19-3647-4516-822a-d5be05161d87 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:36.742262 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-95555a19-3647-4516-822a-d5be05161d87 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:36.742881 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-95555a19-3647-4516-822a-d5be05161d87 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:36.743468 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-95555a19-3647-4516-822a-d5be05161d87 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:36.819111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-76ccfc8e-4f8b-4d5a-bfad-d4bd44f56ba2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:36.819729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-76ccfc8e-4f8b-4d5a-bfad-d4bd44f56ba2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:36.826544 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76ccfc8e-4f8b-4d5a-bfad-d4bd44f56ba2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:36.827026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76ccfc8e-4f8b-4d5a-bfad-d4bd44f56ba2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:36.827486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76ccfc8e-4f8b-4d5a-bfad-d4bd44f56ba2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:36.828168 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76ccfc8e-4f8b-4d5a-bfad-d4bd44f56ba2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:36.828611 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76ccfc8e-4f8b-4d5a-bfad-d4bd44f56ba2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:36.829051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76ccfc8e-4f8b-4d5a-bfad-d4bd44f56ba2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:36.879535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-95555a19-3647-4516-822a-d5be05161d87 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:36.889449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-95555a19-3647-4516-822a-d5be05161d87 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:36.891182 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-95555a19-3647-4516-822a-d5be05161d87 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:36.892589 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-95555a19-3647-4516-822a-d5be05161d87 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1744 microversion: 2.20 time: 0.168849 Sep 06 16:25:36.893250 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 532/1084] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:36 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:36.970283 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-76ccfc8e-4f8b-4d5a-bfad-d4bd44f56ba2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:36.979754 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-76ccfc8e-4f8b-4d5a-bfad-d4bd44f56ba2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.164542 Sep 06 16:25:36.980447 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 553/1085] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:36 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:25:37.919110 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b6e24e3a-028c-4714-bcee-42f776e50c18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:37.919729 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b6e24e3a-028c-4714-bcee-42f776e50c18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:37.926724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b6e24e3a-028c-4714-bcee-42f776e50c18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:37.927210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b6e24e3a-028c-4714-bcee-42f776e50c18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:37.928006 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b6e24e3a-028c-4714-bcee-42f776e50c18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:37.928733 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b6e24e3a-028c-4714-bcee-42f776e50c18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:37.929222 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b6e24e3a-028c-4714-bcee-42f776e50c18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:37.929642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b6e24e3a-028c-4714-bcee-42f776e50c18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:37.949335 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=100 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:38.005597 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-573ffce8-9e24-4641-8765-7164cf106dc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:38.006206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-573ffce8-9e24-4641-8765-7164cf106dc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:38.013444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-573ffce8-9e24-4641-8765-7164cf106dc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:38.014000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-573ffce8-9e24-4641-8765-7164cf106dc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:38.014672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-573ffce8-9e24-4641-8765-7164cf106dc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:38.015653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-573ffce8-9e24-4641-8765-7164cf106dc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:38.016321 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-573ffce8-9e24-4641-8765-7164cf106dc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:38.016744 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-573ffce8-9e24-4641-8765-7164cf106dc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:38.088879 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b6e24e3a-028c-4714-bcee-42f776e50c18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:38.098764 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b6e24e3a-028c-4714-bcee-42f776e50c18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:38.100611 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b6e24e3a-028c-4714-bcee-42f776e50c18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:38.102038 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b6e24e3a-028c-4714-bcee-42f776e50c18 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1744 microversion: 2.20 time: 0.187108 Sep 06 16:25:38.102598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 533/1086] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:37 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:38.161009 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-573ffce8-9e24-4641-8765-7164cf106dc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:38.169362 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-573ffce8-9e24-4641-8765-7164cf106dc6 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.167792 Sep 06 16:25:38.169858 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 554/1087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:38 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:25:39.127582 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a479b0ce-8fd2-4884-af26-709a7ee9366a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:39.128184 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a479b0ce-8fd2-4884-af26-709a7ee9366a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:39.137580 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a479b0ce-8fd2-4884-af26-709a7ee9366a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:39.139107 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a479b0ce-8fd2-4884-af26-709a7ee9366a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:39.139537 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a479b0ce-8fd2-4884-af26-709a7ee9366a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:39.140237 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a479b0ce-8fd2-4884-af26-709a7ee9366a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:39.140689 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a479b0ce-8fd2-4884-af26-709a7ee9366a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:39.141129 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a479b0ce-8fd2-4884-af26-709a7ee9366a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:39.195427 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f21aaddf-cef7-467e-ab34-c75ee19c112c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:39.196849 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f21aaddf-cef7-467e-ab34-c75ee19c112c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:39.221732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f21aaddf-cef7-467e-ab34-c75ee19c112c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:39.222539 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f21aaddf-cef7-467e-ab34-c75ee19c112c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:39.222972 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f21aaddf-cef7-467e-ab34-c75ee19c112c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:39.223692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f21aaddf-cef7-467e-ab34-c75ee19c112c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:39.224137 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f21aaddf-cef7-467e-ab34-c75ee19c112c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:39.224553 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f21aaddf-cef7-467e-ab34-c75ee19c112c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:39.341775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a479b0ce-8fd2-4884-af26-709a7ee9366a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:39.360591 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a479b0ce-8fd2-4884-af26-709a7ee9366a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:39.362856 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a479b0ce-8fd2-4884-af26-709a7ee9366a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:39.364705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a479b0ce-8fd2-4884-af26-709a7ee9366a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1739 microversion: 2.20 time: 0.240956 Sep 06 16:25:39.365652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 534/1088] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:39 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:25:39.426824 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f21aaddf-cef7-467e-ab34-c75ee19c112c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:39.436532 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f21aaddf-cef7-467e-ab34-c75ee19c112c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.248157 Sep 06 16:25:39.437476 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 555/1089] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:39 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:25:40.397935 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6f51a8ae-b0aa-4475-8918-cdf210dd4f48 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:40.399248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6f51a8ae-b0aa-4475-8918-cdf210dd4f48 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:40.411050 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:40.413754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6f51a8ae-b0aa-4475-8918-cdf210dd4f48 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:40.414595 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6f51a8ae-b0aa-4475-8918-cdf210dd4f48 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:40.416914 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6f51a8ae-b0aa-4475-8918-cdf210dd4f48 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:40.418144 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6f51a8ae-b0aa-4475-8918-cdf210dd4f48 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:40.418913 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6f51a8ae-b0aa-4475-8918-cdf210dd4f48 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:40.419569 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6f51a8ae-b0aa-4475-8918-cdf210dd4f48 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:40.472844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-db500cd9-5809-4a90-bc43-f58f8b18b640 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:40.474720 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-db500cd9-5809-4a90-bc43-f58f8b18b640 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:40.488137 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db500cd9-5809-4a90-bc43-f58f8b18b640 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:40.489441 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db500cd9-5809-4a90-bc43-f58f8b18b640 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:40.490620 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db500cd9-5809-4a90-bc43-f58f8b18b640 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:40.491527 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db500cd9-5809-4a90-bc43-f58f8b18b640 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:40.492145 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db500cd9-5809-4a90-bc43-f58f8b18b640 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:40.492730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db500cd9-5809-4a90-bc43-f58f8b18b640 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:40.668800 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6f51a8ae-b0aa-4475-8918-cdf210dd4f48 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:40.681702 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6f51a8ae-b0aa-4475-8918-cdf210dd4f48 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:40.683774 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6f51a8ae-b0aa-4475-8918-cdf210dd4f48 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:40.685210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6f51a8ae-b0aa-4475-8918-cdf210dd4f48 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1739 microversion: 2.20 time: 0.292038 Sep 06 16:25:40.693263 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 535/1090] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:40 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:40.694126 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-db500cd9-5809-4a90-bc43-f58f8b18b640 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:40.717355 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-db500cd9-5809-4a90-bc43-f58f8b18b640 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.261075 Sep 06 16:25:40.719412 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 556/1091] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:40 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:25:41.715815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0a402402-f284-44b9-9a14-86651947e22a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:41.716785 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0a402402-f284-44b9-9a14-86651947e22a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:41.720835 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:41.725543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0a402402-f284-44b9-9a14-86651947e22a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:41.726410 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0a402402-f284-44b9-9a14-86651947e22a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:41.726995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0a402402-f284-44b9-9a14-86651947e22a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:41.727846 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0a402402-f284-44b9-9a14-86651947e22a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:41.728447 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0a402402-f284-44b9-9a14-86651947e22a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:41.729043 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0a402402-f284-44b9-9a14-86651947e22a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:41.747721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5192997d-4940-429d-b736-19fb4fc317fe tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:41.748322 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5192997d-4940-429d-b736-19fb4fc317fe tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:41.758282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5192997d-4940-429d-b736-19fb4fc317fe tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:41.761116 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5192997d-4940-429d-b736-19fb4fc317fe tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:41.761791 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5192997d-4940-429d-b736-19fb4fc317fe tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:41.763454 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5192997d-4940-429d-b736-19fb4fc317fe tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:41.765317 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5192997d-4940-429d-b736-19fb4fc317fe tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:41.765972 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5192997d-4940-429d-b736-19fb4fc317fe tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:41.995379 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0a402402-f284-44b9-9a14-86651947e22a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:42.000236 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=8 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:42.010284 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0a402402-f284-44b9-9a14-86651947e22a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:42.013626 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0a402402-f284-44b9-9a14-86651947e22a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:42.015080 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0a402402-f284-44b9-9a14-86651947e22a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1739 microversion: 2.20 time: 0.304545 Sep 06 16:25:42.031081 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 536/1092] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:41 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:42.095328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5192997d-4940-429d-b736-19fb4fc317fe tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:42.107643 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5192997d-4940-429d-b736-19fb4fc317fe tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.363887 Sep 06 16:25:42.109175 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 557/1093] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:41 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:25:43.055446 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-140d5141-1c94-443c-865d-ff52c88cd8d7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:43.057266 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-140d5141-1c94-443c-865d-ff52c88cd8d7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:43.072203 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-140d5141-1c94-443c-865d-ff52c88cd8d7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:43.072929 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-140d5141-1c94-443c-865d-ff52c88cd8d7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:43.074995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-140d5141-1c94-443c-865d-ff52c88cd8d7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:43.075948 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-140d5141-1c94-443c-865d-ff52c88cd8d7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:43.086980 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-140d5141-1c94-443c-865d-ff52c88cd8d7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:43.087452 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-140d5141-1c94-443c-865d-ff52c88cd8d7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:43.153999 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3fb97554-c730-445f-8961-5f4ca27319e7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:43.153999 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3fb97554-c730-445f-8961-5f4ca27319e7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:43.159908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3fb97554-c730-445f-8961-5f4ca27319e7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:43.171173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3fb97554-c730-445f-8961-5f4ca27319e7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:43.171916 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3fb97554-c730-445f-8961-5f4ca27319e7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:43.174365 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3fb97554-c730-445f-8961-5f4ca27319e7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:43.175042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3fb97554-c730-445f-8961-5f4ca27319e7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:43.179103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3fb97554-c730-445f-8961-5f4ca27319e7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:43.383662 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-140d5141-1c94-443c-865d-ff52c88cd8d7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:43.399411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-140d5141-1c94-443c-865d-ff52c88cd8d7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:43.400975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-140d5141-1c94-443c-865d-ff52c88cd8d7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:43.402200 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-140d5141-1c94-443c-865d-ff52c88cd8d7 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1739 microversion: 2.20 time: 0.353670 Sep 06 16:25:43.419990 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 537/1094] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:43 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1739 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:43.423993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3fb97554-c730-445f-8961-5f4ca27319e7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:43.435267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3fb97554-c730-445f-8961-5f4ca27319e7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.301833 Sep 06 16:25:43.437316 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 558/1095] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:43 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:25:44.429688 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-07ffcdcb-2d67-4da9-9c1c-30ad3bd402b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:44.430563 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-07ffcdcb-2d67-4da9-9c1c-30ad3bd402b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:44.438615 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07ffcdcb-2d67-4da9-9c1c-30ad3bd402b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:44.439249 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07ffcdcb-2d67-4da9-9c1c-30ad3bd402b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:44.440802 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07ffcdcb-2d67-4da9-9c1c-30ad3bd402b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:44.441547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07ffcdcb-2d67-4da9-9c1c-30ad3bd402b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:44.442201 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07ffcdcb-2d67-4da9-9c1c-30ad3bd402b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:44.442815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-07ffcdcb-2d67-4da9-9c1c-30ad3bd402b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:44.461728 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-96f4d204-9f94-4425-bb64-882d5777622d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:44.463434 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-96f4d204-9f94-4425-bb64-882d5777622d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:44.466582 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:44.473485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96f4d204-9f94-4425-bb64-882d5777622d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:44.475136 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96f4d204-9f94-4425-bb64-882d5777622d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:44.475874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96f4d204-9f94-4425-bb64-882d5777622d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:44.476989 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96f4d204-9f94-4425-bb64-882d5777622d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:44.477747 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96f4d204-9f94-4425-bb64-882d5777622d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:44.478281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-96f4d204-9f94-4425-bb64-882d5777622d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:44.625945 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-07ffcdcb-2d67-4da9-9c1c-30ad3bd402b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:44.634575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-07ffcdcb-2d67-4da9-9c1c-30ad3bd402b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:44.636053 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-07ffcdcb-2d67-4da9-9c1c-30ad3bd402b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:44.637332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-07ffcdcb-2d67-4da9-9c1c-30ad3bd402b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1739 microversion: 2.20 time: 0.212767 Sep 06 16:25:44.645035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 538/1096] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:44 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:44.668580 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-96f4d204-9f94-4425-bb64-882d5777622d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:44.682813 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-96f4d204-9f94-4425-bb64-882d5777622d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.226152 Sep 06 16:25:44.683577 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 559/1097] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:44 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:45.683838 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c552dae0-1368-4047-bc54-d6786f3b0009 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:45.685307 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c552dae0-1368-4047-bc54-d6786f3b0009 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:45.694163 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c552dae0-1368-4047-bc54-d6786f3b0009 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:45.694899 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c552dae0-1368-4047-bc54-d6786f3b0009 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:45.695415 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c552dae0-1368-4047-bc54-d6786f3b0009 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:45.696104 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c552dae0-1368-4047-bc54-d6786f3b0009 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:45.697384 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c552dae0-1368-4047-bc54-d6786f3b0009 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:45.698007 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c552dae0-1368-4047-bc54-d6786f3b0009 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:45.706024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6ea57f18-911a-455f-89bd-79df68dc810d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:45.707389 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6ea57f18-911a-455f-89bd-79df68dc810d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:45.718078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6ea57f18-911a-455f-89bd-79df68dc810d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:45.718863 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6ea57f18-911a-455f-89bd-79df68dc810d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:45.719493 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6ea57f18-911a-455f-89bd-79df68dc810d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:45.720438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6ea57f18-911a-455f-89bd-79df68dc810d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:45.721205 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6ea57f18-911a-455f-89bd-79df68dc810d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:45.721848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6ea57f18-911a-455f-89bd-79df68dc810d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:45.940776 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6ea57f18-911a-455f-89bd-79df68dc810d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:45.950599 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6ea57f18-911a-455f-89bd-79df68dc810d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.248721 Sep 06 16:25:45.951205 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 560/1098] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:45 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:46.248909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c552dae0-1368-4047-bc54-d6786f3b0009 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:46.258136 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c552dae0-1368-4047-bc54-d6786f3b0009 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:46.262135 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c552dae0-1368-4047-bc54-d6786f3b0009 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:46.263723 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c552dae0-1368-4047-bc54-d6786f3b0009 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1739 microversion: 2.20 time: 0.586768 Sep 06 16:25:46.278888 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 539/1099] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:45 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1739 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:46.976774 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-601f1769-c46a-4194-976b-4157621cc405 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:46.978407 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-601f1769-c46a-4194-976b-4157621cc405 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:47.006530 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-601f1769-c46a-4194-976b-4157621cc405 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:47.007426 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-601f1769-c46a-4194-976b-4157621cc405 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:47.007983 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-601f1769-c46a-4194-976b-4157621cc405 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:47.009587 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-601f1769-c46a-4194-976b-4157621cc405 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:47.011407 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-601f1769-c46a-4194-976b-4157621cc405 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:47.013027 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-601f1769-c46a-4194-976b-4157621cc405 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:47.292949 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a6f84c70-ea28-4476-b672-a0817aa95482 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:47.294429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a6f84c70-ea28-4476-b672-a0817aa95482 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:47.309523 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6f84c70-ea28-4476-b672-a0817aa95482 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:47.313909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6f84c70-ea28-4476-b672-a0817aa95482 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:47.314798 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6f84c70-ea28-4476-b672-a0817aa95482 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:47.315925 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6f84c70-ea28-4476-b672-a0817aa95482 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:47.317804 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6f84c70-ea28-4476-b672-a0817aa95482 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:47.319630 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a6f84c70-ea28-4476-b672-a0817aa95482 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:47.333780 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-601f1769-c46a-4194-976b-4157621cc405 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:47.349360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-601f1769-c46a-4194-976b-4157621cc405 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.376607 Sep 06 16:25:47.375780 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 561/1100] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:46 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:47.557546 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a6f84c70-ea28-4476-b672-a0817aa95482 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:47.569293 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a6f84c70-ea28-4476-b672-a0817aa95482 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:47.570845 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a6f84c70-ea28-4476-b672-a0817aa95482 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:47.572102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a6f84c70-ea28-4476-b672-a0817aa95482 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1739 microversion: 2.20 time: 0.284101 Sep 06 16:25:47.573101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 540/1101] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:47 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:25:48.382049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b9d4cf03-62e9-4cff-ac6a-c805d44353c7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:48.383171 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b9d4cf03-62e9-4cff-ac6a-c805d44353c7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:48.390779 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b9d4cf03-62e9-4cff-ac6a-c805d44353c7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:48.392022 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b9d4cf03-62e9-4cff-ac6a-c805d44353c7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:48.392475 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b9d4cf03-62e9-4cff-ac6a-c805d44353c7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:48.393483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b9d4cf03-62e9-4cff-ac6a-c805d44353c7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:48.394183 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b9d4cf03-62e9-4cff-ac6a-c805d44353c7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:48.394839 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b9d4cf03-62e9-4cff-ac6a-c805d44353c7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:48.612360 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-66949fc8-b4de-4470-8408-0a02f7acb47d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:48.615684 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-66949fc8-b4de-4470-8408-0a02f7acb47d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:48.633809 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-66949fc8-b4de-4470-8408-0a02f7acb47d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:48.641542 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-66949fc8-b4de-4470-8408-0a02f7acb47d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:48.642490 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-66949fc8-b4de-4470-8408-0a02f7acb47d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:48.643420 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-66949fc8-b4de-4470-8408-0a02f7acb47d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:48.646251 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-66949fc8-b4de-4470-8408-0a02f7acb47d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:48.647908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-66949fc8-b4de-4470-8408-0a02f7acb47d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:48.844788 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b9d4cf03-62e9-4cff-ac6a-c805d44353c7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:48.859688 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b9d4cf03-62e9-4cff-ac6a-c805d44353c7 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.481774 Sep 06 16:25:48.860976 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 562/1102] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:48 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:48.879883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-579aac19-9bd8-4406-820a-904a373622be req-407ae38f-2704-4bb3-9953-5496de9fb422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9288c862-6167-4869-98a5-8121505ea169", "name": "network-vif-plugged", "status": "completed", "tag": "791df2dc-93bb-4c44-8f32-337aa6fcd193"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:48.906329 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-579aac19-9bd8-4406-820a-904a373622be req-407ae38f-2704-4bb3-9953-5496de9fb422 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:48.907646 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-579aac19-9bd8-4406-820a-904a373622be req-407ae38f-2704-4bb3-9953-5496de9fb422 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:48.909232 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-579aac19-9bd8-4406-820a-904a373622be req-407ae38f-2704-4bb3-9953-5496de9fb422 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:48.921543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-66949fc8-b4de-4470-8408-0a02f7acb47d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:48.931680 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-579aac19-9bd8-4406-820a-904a373622be req-407ae38f-2704-4bb3-9953-5496de9fb422 service nova] Creating event network-vif-plugged:791df2dc-93bb-4c44-8f32-337aa6fcd193 for instance 9288c862-6167-4869-98a5-8121505ea169 on hv-cinder-85221 Sep 06 16:25:48.935205 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-66949fc8-b4de-4470-8408-0a02f7acb47d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:48.937945 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-66949fc8-b4de-4470-8408-0a02f7acb47d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:48.938922 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-579aac19-9bd8-4406-820a-904a373622be req-407ae38f-2704-4bb3-9953-5496de9fb422 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076008 Sep 06 16:25:48.939174 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-66949fc8-b4de-4470-8408-0a02f7acb47d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1739 microversion: 2.20 time: 0.339292 Sep 06 16:25:48.939779 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 563/1103] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:48.941924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 541/1104] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:48 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1739 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:49.889500 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-251ee816-1ab8-46da-a6f7-5631c6f71f9b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:49.892582 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-251ee816-1ab8-46da-a6f7-5631c6f71f9b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:49.919745 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-251ee816-1ab8-46da-a6f7-5631c6f71f9b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:49.922405 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-251ee816-1ab8-46da-a6f7-5631c6f71f9b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:49.923313 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-251ee816-1ab8-46da-a6f7-5631c6f71f9b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:49.924829 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-251ee816-1ab8-46da-a6f7-5631c6f71f9b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:49.925608 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-251ee816-1ab8-46da-a6f7-5631c6f71f9b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:49.926199 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-251ee816-1ab8-46da-a6f7-5631c6f71f9b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:49.971247 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e3e33621-3f9d-4742-9e0f-b506761ad6ee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:49.971854 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e3e33621-3f9d-4742-9e0f-b506761ad6ee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:49.988472 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e3e33621-3f9d-4742-9e0f-b506761ad6ee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:49.993705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e3e33621-3f9d-4742-9e0f-b506761ad6ee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:49.994914 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e3e33621-3f9d-4742-9e0f-b506761ad6ee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:50.000639 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e3e33621-3f9d-4742-9e0f-b506761ad6ee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:50.001544 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e3e33621-3f9d-4742-9e0f-b506761ad6ee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:50.002115 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e3e33621-3f9d-4742-9e0f-b506761ad6ee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:50.096957 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-251ee816-1ab8-46da-a6f7-5631c6f71f9b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:50.106652 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-251ee816-1ab8-46da-a6f7-5631c6f71f9b tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.226635 Sep 06 16:25:50.115051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 564/1105] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:49 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:50.181049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e3e33621-3f9d-4742-9e0f-b506761ad6ee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:50.192785 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e3e33621-3f9d-4742-9e0f-b506761ad6ee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:50.194565 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e3e33621-3f9d-4742-9e0f-b506761ad6ee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:50.196132 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e3e33621-3f9d-4742-9e0f-b506761ad6ee tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1739 microversion: 2.20 time: 0.230060 Sep 06 16:25:50.197401 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 542/1106] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:49 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:51.139022 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5d9e071c-922e-4fef-8d1a-10f3135ae166 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:51.139776 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5d9e071c-922e-4fef-8d1a-10f3135ae166 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:51.146285 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5d9e071c-922e-4fef-8d1a-10f3135ae166 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:51.146744 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5d9e071c-922e-4fef-8d1a-10f3135ae166 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:51.147202 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5d9e071c-922e-4fef-8d1a-10f3135ae166 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:51.148006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5d9e071c-922e-4fef-8d1a-10f3135ae166 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:51.148475 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5d9e071c-922e-4fef-8d1a-10f3135ae166 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:51.148915 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5d9e071c-922e-4fef-8d1a-10f3135ae166 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:51.223211 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c7e0681f-fca4-4b1f-9fee-9bed4fea9278 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:51.223826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c7e0681f-fca4-4b1f-9fee-9bed4fea9278 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:51.232224 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c7e0681f-fca4-4b1f-9fee-9bed4fea9278 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:51.232716 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c7e0681f-fca4-4b1f-9fee-9bed4fea9278 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:51.233266 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c7e0681f-fca4-4b1f-9fee-9bed4fea9278 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:51.234191 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c7e0681f-fca4-4b1f-9fee-9bed4fea9278 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:51.235016 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c7e0681f-fca4-4b1f-9fee-9bed4fea9278 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:51.235140 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c7e0681f-fca4-4b1f-9fee-9bed4fea9278 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:51.324083 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5d9e071c-922e-4fef-8d1a-10f3135ae166 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:51.333862 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5d9e071c-922e-4fef-8d1a-10f3135ae166 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1266 microversion: 2.1 time: 0.199606 Sep 06 16:25:51.334573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 565/1107] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:51 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:51.407073 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c7e0681f-fca4-4b1f-9fee-9bed4fea9278 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:51.417489 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c7e0681f-fca4-4b1f-9fee-9bed4fea9278 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:51.419434 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c7e0681f-fca4-4b1f-9fee-9bed4fea9278 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:51.421455 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c7e0681f-fca4-4b1f-9fee-9bed4fea9278 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1739 microversion: 2.20 time: 0.202271 Sep 06 16:25:51.422290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 543/1108] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:51 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:52.357486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-11285fbf-4e9a-4ec6-81e7-ecad3a2cf1d2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:52.358131 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-11285fbf-4e9a-4ec6-81e7-ecad3a2cf1d2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:52.364735 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-11285fbf-4e9a-4ec6-81e7-ecad3a2cf1d2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:52.365246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-11285fbf-4e9a-4ec6-81e7-ecad3a2cf1d2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:52.365675 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-11285fbf-4e9a-4ec6-81e7-ecad3a2cf1d2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:52.366373 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-11285fbf-4e9a-4ec6-81e7-ecad3a2cf1d2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:52.367462 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-11285fbf-4e9a-4ec6-81e7-ecad3a2cf1d2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:52.367885 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-11285fbf-4e9a-4ec6-81e7-ecad3a2cf1d2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:52.453272 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-eddca9dc-dd22-4c84-82af-e6a2c339f9a3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:52.454049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-eddca9dc-dd22-4c84-82af-e6a2c339f9a3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:52.461520 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eddca9dc-dd22-4c84-82af-e6a2c339f9a3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:52.462165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eddca9dc-dd22-4c84-82af-e6a2c339f9a3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:52.462747 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eddca9dc-dd22-4c84-82af-e6a2c339f9a3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:52.463859 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eddca9dc-dd22-4c84-82af-e6a2c339f9a3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:52.464453 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eddca9dc-dd22-4c84-82af-e6a2c339f9a3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:52.465114 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eddca9dc-dd22-4c84-82af-e6a2c339f9a3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:52.510849 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-11285fbf-4e9a-4ec6-81e7-ecad3a2cf1d2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:52.519146 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-11285fbf-4e9a-4ec6-81e7-ecad3a2cf1d2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1454 microversion: 2.1 time: 0.165623 Sep 06 16:25:52.519812 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 566/1109] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:52 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:52.541470 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ce6e6d1f-49a8-4967-8f04-512673067948 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:52.542084 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ce6e6d1f-49a8-4967-8f04-512673067948 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:52.548389 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce6e6d1f-49a8-4967-8f04-512673067948 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:52.548897 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce6e6d1f-49a8-4967-8f04-512673067948 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:52.549295 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce6e6d1f-49a8-4967-8f04-512673067948 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:52.550026 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce6e6d1f-49a8-4967-8f04-512673067948 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:52.550475 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce6e6d1f-49a8-4967-8f04-512673067948 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:52.550887 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce6e6d1f-49a8-4967-8f04-512673067948 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:52.684936 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-eddca9dc-dd22-4c84-82af-e6a2c339f9a3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:52.689222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ce6e6d1f-49a8-4967-8f04-512673067948 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:52.693848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:52.695497 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-eddca9dc-dd22-4c84-82af-e6a2c339f9a3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:52.697194 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-eddca9dc-dd22-4c84-82af-e6a2c339f9a3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:52.698467 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-eddca9dc-dd22-4c84-82af-e6a2c339f9a3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1721 microversion: 2.20 time: 0.250606 Sep 06 16:25:52.699148 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ce6e6d1f-49a8-4967-8f04-512673067948 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1454 microversion: 2.1 time: 0.161493 Sep 06 16:25:52.699726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 567/1110] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:52 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:25:52.705527 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 544/1111] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:52 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:53.726195 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5877a9c0-9ece-411f-9331-56268621db33 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:53.726908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5877a9c0-9ece-411f-9331-56268621db33 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:53.734513 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5877a9c0-9ece-411f-9331-56268621db33 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:53.735000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5877a9c0-9ece-411f-9331-56268621db33 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:53.735418 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5877a9c0-9ece-411f-9331-56268621db33 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:53.736341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5877a9c0-9ece-411f-9331-56268621db33 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:53.736844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5877a9c0-9ece-411f-9331-56268621db33 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:53.737233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5877a9c0-9ece-411f-9331-56268621db33 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:53.882770 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5877a9c0-9ece-411f-9331-56268621db33 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:53.893805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5877a9c0-9ece-411f-9331-56268621db33 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:53.895329 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-5877a9c0-9ece-411f-9331-56268621db33 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:53.896846 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5877a9c0-9ece-411f-9331-56268621db33 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1721 microversion: 2.20 time: 0.175157 Sep 06 16:25:53.905042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 568/1112] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:53 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:54.497417 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-c67907e6-116f-42dd-85f4-1f97c51f7972 req-f1762595-b0ba-4cce-b637-5d666b916bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5393a1be-4392-48fb-b317-79525e0639b6", "name": "network-vif-unplugged", "status": "completed", "tag": "871e4881-cbaf-4c42-8c18-28566def207e"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:54.510931 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-c67907e6-116f-42dd-85f4-1f97c51f7972 req-f1762595-b0ba-4cce-b637-5d666b916bbb service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:54.512662 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-c67907e6-116f-42dd-85f4-1f97c51f7972 req-f1762595-b0ba-4cce-b637-5d666b916bbb service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:54.513520 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-c67907e6-116f-42dd-85f4-1f97c51f7972 req-f1762595-b0ba-4cce-b637-5d666b916bbb service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:54.527462 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-c67907e6-116f-42dd-85f4-1f97c51f7972 req-f1762595-b0ba-4cce-b637-5d666b916bbb service nova] Creating event network-vif-unplugged:871e4881-cbaf-4c42-8c18-28566def207e for instance 5393a1be-4392-48fb-b317-79525e0639b6 on hv-cinder-85221 Sep 06 16:25:54.533102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-c67907e6-116f-42dd-85f4-1f97c51f7972 req-f1762595-b0ba-4cce-b637-5d666b916bbb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039885 Sep 06 16:25:54.533926 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 545/1113] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:25:54.650392 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-66a0c53c-0e19-465d-9fe3-46e56329080f req-2ba5da44-a825-48eb-b76b-8753578a1883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9288c862-6167-4869-98a5-8121505ea169", "tag": "791df2dc-93bb-4c44-8f32-337aa6fcd193"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:54.661090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-66a0c53c-0e19-465d-9fe3-46e56329080f req-2ba5da44-a825-48eb-b76b-8753578a1883 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:54.661090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-66a0c53c-0e19-465d-9fe3-46e56329080f req-2ba5da44-a825-48eb-b76b-8753578a1883 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:54.661090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-66a0c53c-0e19-465d-9fe3-46e56329080f req-2ba5da44-a825-48eb-b76b-8753578a1883 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:54.673108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-66a0c53c-0e19-465d-9fe3-46e56329080f req-2ba5da44-a825-48eb-b76b-8753578a1883 service nova] Creating event network-changed:791df2dc-93bb-4c44-8f32-337aa6fcd193 for instance 9288c862-6167-4869-98a5-8121505ea169 on hv-cinder-85221 Sep 06 16:25:54.678968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-66a0c53c-0e19-465d-9fe3-46e56329080f req-2ba5da44-a825-48eb-b76b-8753578a1883 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032073 Sep 06 16:25:54.683158 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 569/1114] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:54.927794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d25462cf-efb4-4517-9e36-e67283c53ccd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:54.928510 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d25462cf-efb4-4517-9e36-e67283c53ccd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:54.935563 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d25462cf-efb4-4517-9e36-e67283c53ccd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:54.936954 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d25462cf-efb4-4517-9e36-e67283c53ccd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:54.937546 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d25462cf-efb4-4517-9e36-e67283c53ccd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:54.938412 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d25462cf-efb4-4517-9e36-e67283c53ccd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:54.939228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d25462cf-efb4-4517-9e36-e67283c53ccd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:54.939805 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d25462cf-efb4-4517-9e36-e67283c53ccd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:55.168255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d25462cf-efb4-4517-9e36-e67283c53ccd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:55.179473 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d25462cf-efb4-4517-9e36-e67283c53ccd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:55.181419 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d25462cf-efb4-4517-9e36-e67283c53ccd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:55.183345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d25462cf-efb4-4517-9e36-e67283c53ccd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1724 microversion: 2.20 time: 0.260242 Sep 06 16:25:55.184057 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 546/1115] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:54 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:25:55.217428 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c67b52f3-31be-4cb7-8bda-0db0ebb8d0a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b2c65a0-ae93-40fb-9c1d-14505b91acb4"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:55.221682 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c67b52f3-31be-4cb7-8bda-0db0ebb8d0a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:55.230241 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c67b52f3-31be-4cb7-8bda-0db0ebb8d0a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:55.231425 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c67b52f3-31be-4cb7-8bda-0db0ebb8d0a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:55.232067 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c67b52f3-31be-4cb7-8bda-0db0ebb8d0a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:55.233300 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c67b52f3-31be-4cb7-8bda-0db0ebb8d0a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:55.233912 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c67b52f3-31be-4cb7-8bda-0db0ebb8d0a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:55.234474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c67b52f3-31be-4cb7-8bda-0db0ebb8d0a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:55.665820 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c67b52f3-31be-4cb7-8bda-0db0ebb8d0a0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "POST /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.453876 Sep 06 16:25:55.672078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 570/1116] 10.222.0.43 () {62 vars in 1364 bytes} [Tue Sep 6 16:25:55 2022] POST /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/os-volume_attachments => generated 188 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:25:55.830313 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1e6a9dec-f092-4ecb-b4d6-202a1ea1d00c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:55.830982 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1e6a9dec-f092-4ecb-b4d6-202a1ea1d00c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:55.838148 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1e6a9dec-f092-4ecb-b4d6-202a1ea1d00c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:55.838741 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1e6a9dec-f092-4ecb-b4d6-202a1ea1d00c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:55.839118 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1e6a9dec-f092-4ecb-b4d6-202a1ea1d00c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:55.839846 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1e6a9dec-f092-4ecb-b4d6-202a1ea1d00c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:55.840306 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1e6a9dec-f092-4ecb-b4d6-202a1ea1d00c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:55.840737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1e6a9dec-f092-4ecb-b4d6-202a1ea1d00c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:56.136607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1e6a9dec-f092-4ecb-b4d6-202a1ea1d00c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/os-volume_attachments/7b2c65a0-ae93-40fb-9c1d-14505b91acb4" status: 202 len: 0 microversion: 2.20 time: 0.310326 Sep 06 16:25:56.137688 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 547/1117] 10.222.0.43 () {60 vars in 1457 bytes} [Tue Sep 6 16:25:55 2022] DELETE /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/os-volume_attachments/7b2c65a0-ae93-40fb-9c1d-14505b91acb4 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:25:56.200375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e772a29e-a2bf-4b38-9e59-14250ec5780f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:56.201025 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e772a29e-a2bf-4b38-9e59-14250ec5780f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:56.207288 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e772a29e-a2bf-4b38-9e59-14250ec5780f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:56.207792 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e772a29e-a2bf-4b38-9e59-14250ec5780f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:56.208193 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e772a29e-a2bf-4b38-9e59-14250ec5780f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:56.208914 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e772a29e-a2bf-4b38-9e59-14250ec5780f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:56.209356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e772a29e-a2bf-4b38-9e59-14250ec5780f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:56.209772 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e772a29e-a2bf-4b38-9e59-14250ec5780f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:56.258399 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e772a29e-a2bf-4b38-9e59-14250ec5780f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120668) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 16:25:56.345666 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e772a29e-a2bf-4b38-9e59-14250ec5780f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "POST /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/action" status: 202 len: 0 microversion: 2.20 time: 0.149552 Sep 06 16:25:56.346625 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 571/1118] 10.222.0.43 () {62 vars in 1319 bytes} [Tue Sep 6 16:25:56 2022] POST /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:25:56.622629 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1dbf1505-4469-4202-87f5-ab599e61ee23 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:56.623240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1dbf1505-4469-4202-87f5-ab599e61ee23 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:56.631508 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1dbf1505-4469-4202-87f5-ab599e61ee23 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:56.632229 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1dbf1505-4469-4202-87f5-ab599e61ee23 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:56.633126 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1dbf1505-4469-4202-87f5-ab599e61ee23 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:56.634626 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1dbf1505-4469-4202-87f5-ab599e61ee23 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:56.635089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1dbf1505-4469-4202-87f5-ab599e61ee23 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:56.635493 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1dbf1505-4469-4202-87f5-ab599e61ee23 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:56.652877 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:56.784089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1dbf1505-4469-4202-87f5-ab599e61ee23 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:56.796804 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1dbf1505-4469-4202-87f5-ab599e61ee23 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:56.798755 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1dbf1505-4469-4202-87f5-ab599e61ee23 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:56.801701 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1dbf1505-4469-4202-87f5-ab599e61ee23 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1672 microversion: 2.20 time: 0.450585 Sep 06 16:25:56.803204 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 548/1119] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:56 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1672 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:57.835170 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-800544ce-ac4f-4921-89df-b977c53917ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:57.835649 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-800544ce-ac4f-4921-89df-b977c53917ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:57.843688 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-800544ce-ac4f-4921-89df-b977c53917ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:57.844387 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-800544ce-ac4f-4921-89df-b977c53917ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:57.845027 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-800544ce-ac4f-4921-89df-b977c53917ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:57.845760 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-800544ce-ac4f-4921-89df-b977c53917ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:57.846231 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-800544ce-ac4f-4921-89df-b977c53917ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:57.846655 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-800544ce-ac4f-4921-89df-b977c53917ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:58.004125 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-800544ce-ac4f-4921-89df-b977c53917ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:58.012719 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-800544ce-ac4f-4921-89df-b977c53917ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:58.014246 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-800544ce-ac4f-4921-89df-b977c53917ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:58.015476 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-800544ce-ac4f-4921-89df-b977c53917ad tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.188026 Sep 06 16:25:58.015957 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 572/1120] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:57 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:25:59.044360 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6cad7041-e857-4f28-8d2b-4a7953028749 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:59.045261 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6cad7041-e857-4f28-8d2b-4a7953028749 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:59.053547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cad7041-e857-4f28-8d2b-4a7953028749 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:59.054048 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cad7041-e857-4f28-8d2b-4a7953028749 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:59.054527 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cad7041-e857-4f28-8d2b-4a7953028749 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:59.055334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cad7041-e857-4f28-8d2b-4a7953028749 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:59.055768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cad7041-e857-4f28-8d2b-4a7953028749 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:59.056260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6cad7041-e857-4f28-8d2b-4a7953028749 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:59.278149 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6cad7041-e857-4f28-8d2b-4a7953028749 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:59.287566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6cad7041-e857-4f28-8d2b-4a7953028749 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:59.289043 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6cad7041-e857-4f28-8d2b-4a7953028749 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:59.290228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6cad7041-e857-4f28-8d2b-4a7953028749 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.251285 Sep 06 16:25:59.290793 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 549/1121] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:25:59 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:00.319005 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-212e2540-e147-4b8b-82d3-1e19c5211edd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:00.319587 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-212e2540-e147-4b8b-82d3-1e19c5211edd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:00.325734 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-212e2540-e147-4b8b-82d3-1e19c5211edd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:00.326218 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-212e2540-e147-4b8b-82d3-1e19c5211edd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:00.326755 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-212e2540-e147-4b8b-82d3-1e19c5211edd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:00.327439 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-212e2540-e147-4b8b-82d3-1e19c5211edd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:00.327881 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-212e2540-e147-4b8b-82d3-1e19c5211edd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:00.328291 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-212e2540-e147-4b8b-82d3-1e19c5211edd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:00.488335 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-212e2540-e147-4b8b-82d3-1e19c5211edd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:00.498947 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-212e2540-e147-4b8b-82d3-1e19c5211edd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:00.501012 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-212e2540-e147-4b8b-82d3-1e19c5211edd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:00.502657 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-212e2540-e147-4b8b-82d3-1e19c5211edd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.188210 Sep 06 16:26:00.503464 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 573/1122] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:00 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:01.529139 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0b0a5a93-8c23-4b84-9750-aa84e541372b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:01.530031 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0b0a5a93-8c23-4b84-9750-aa84e541372b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:01.537214 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b0a5a93-8c23-4b84-9750-aa84e541372b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:01.537689 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b0a5a93-8c23-4b84-9750-aa84e541372b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:01.538115 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b0a5a93-8c23-4b84-9750-aa84e541372b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:01.538814 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b0a5a93-8c23-4b84-9750-aa84e541372b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:01.539258 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b0a5a93-8c23-4b84-9750-aa84e541372b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:01.539677 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0b0a5a93-8c23-4b84-9750-aa84e541372b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:01.687716 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0b0a5a93-8c23-4b84-9750-aa84e541372b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:01.696480 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0b0a5a93-8c23-4b84-9750-aa84e541372b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:01.698071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0b0a5a93-8c23-4b84-9750-aa84e541372b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:01.699632 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0b0a5a93-8c23-4b84-9750-aa84e541372b tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.174567 Sep 06 16:26:01.700299 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 550/1123] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:01 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:02.726521 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4a71f3b9-eda7-40ef-aa27-9835014a7a90 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:02.727896 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4a71f3b9-eda7-40ef-aa27-9835014a7a90 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:02.735982 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a71f3b9-eda7-40ef-aa27-9835014a7a90 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:02.736499 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a71f3b9-eda7-40ef-aa27-9835014a7a90 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:02.737029 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a71f3b9-eda7-40ef-aa27-9835014a7a90 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:02.737737 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a71f3b9-eda7-40ef-aa27-9835014a7a90 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:02.738280 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a71f3b9-eda7-40ef-aa27-9835014a7a90 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:02.738822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4a71f3b9-eda7-40ef-aa27-9835014a7a90 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:02.911126 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4a71f3b9-eda7-40ef-aa27-9835014a7a90 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:02.921589 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4a71f3b9-eda7-40ef-aa27-9835014a7a90 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:02.923269 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4a71f3b9-eda7-40ef-aa27-9835014a7a90 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:02.924615 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4a71f3b9-eda7-40ef-aa27-9835014a7a90 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.202346 Sep 06 16:26:02.925219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 574/1124] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:02 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:03.955199 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b398b836-1cbe-477c-9743-181da079abe3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:03.955929 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b398b836-1cbe-477c-9743-181da079abe3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:03.964020 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b398b836-1cbe-477c-9743-181da079abe3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:03.964471 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b398b836-1cbe-477c-9743-181da079abe3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:03.964934 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b398b836-1cbe-477c-9743-181da079abe3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:03.965637 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b398b836-1cbe-477c-9743-181da079abe3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:03.966082 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b398b836-1cbe-477c-9743-181da079abe3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:03.966503 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b398b836-1cbe-477c-9743-181da079abe3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:04.121886 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b398b836-1cbe-477c-9743-181da079abe3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:04.130412 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b398b836-1cbe-477c-9743-181da079abe3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:04.131855 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b398b836-1cbe-477c-9743-181da079abe3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:04.133040 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b398b836-1cbe-477c-9743-181da079abe3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.184248 Sep 06 16:26:04.133599 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 551/1125] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:03 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:26:05.166948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e8af3477-64da-497d-9be2-b7cb575c3e60 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:05.167968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e8af3477-64da-497d-9be2-b7cb575c3e60 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:05.176453 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e8af3477-64da-497d-9be2-b7cb575c3e60 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:05.177441 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e8af3477-64da-497d-9be2-b7cb575c3e60 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:05.178118 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e8af3477-64da-497d-9be2-b7cb575c3e60 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:05.178959 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e8af3477-64da-497d-9be2-b7cb575c3e60 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:05.179563 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e8af3477-64da-497d-9be2-b7cb575c3e60 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:05.180095 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e8af3477-64da-497d-9be2-b7cb575c3e60 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:05.346033 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e8af3477-64da-497d-9be2-b7cb575c3e60 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:05.358184 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e8af3477-64da-497d-9be2-b7cb575c3e60 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:05.359929 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e8af3477-64da-497d-9be2-b7cb575c3e60 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:05.361779 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e8af3477-64da-497d-9be2-b7cb575c3e60 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.201515 Sep 06 16:26:05.362551 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 575/1126] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:05 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:06.389765 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-81cef3c4-6bd9-45d1-bebb-769c27a99668 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:06.390349 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-81cef3c4-6bd9-45d1-bebb-769c27a99668 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:06.397274 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-81cef3c4-6bd9-45d1-bebb-769c27a99668 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:06.397754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-81cef3c4-6bd9-45d1-bebb-769c27a99668 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:06.398204 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-81cef3c4-6bd9-45d1-bebb-769c27a99668 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:06.398898 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-81cef3c4-6bd9-45d1-bebb-769c27a99668 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:06.399344 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-81cef3c4-6bd9-45d1-bebb-769c27a99668 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:06.399762 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-81cef3c4-6bd9-45d1-bebb-769c27a99668 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:06.559838 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-81cef3c4-6bd9-45d1-bebb-769c27a99668 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:06.568790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-81cef3c4-6bd9-45d1-bebb-769c27a99668 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:06.570388 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-81cef3c4-6bd9-45d1-bebb-769c27a99668 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:06.571598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-81cef3c4-6bd9-45d1-bebb-769c27a99668 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.186017 Sep 06 16:26:06.572163 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 552/1127] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:06 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:07.598374 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f3e5393f-f090-4763-8102-18e65313b354 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:07.599035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f3e5393f-f090-4763-8102-18e65313b354 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:07.606421 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3e5393f-f090-4763-8102-18e65313b354 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:07.606902 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3e5393f-f090-4763-8102-18e65313b354 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:07.607351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3e5393f-f090-4763-8102-18e65313b354 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:07.608039 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3e5393f-f090-4763-8102-18e65313b354 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:07.608488 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3e5393f-f090-4763-8102-18e65313b354 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:07.609011 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f3e5393f-f090-4763-8102-18e65313b354 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:07.752360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f3e5393f-f090-4763-8102-18e65313b354 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:07.760920 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f3e5393f-f090-4763-8102-18e65313b354 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:07.762460 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f3e5393f-f090-4763-8102-18e65313b354 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:07.764096 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f3e5393f-f090-4763-8102-18e65313b354 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.169627 Sep 06 16:26:07.764748 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 576/1128] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:07 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:08.790657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f1cab77c-2435-419b-ade6-4ece00e1f2b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:08.791315 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f1cab77c-2435-419b-ade6-4ece00e1f2b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:08.797767 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f1cab77c-2435-419b-ade6-4ece00e1f2b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:08.798251 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f1cab77c-2435-419b-ade6-4ece00e1f2b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:08.798682 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f1cab77c-2435-419b-ade6-4ece00e1f2b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:08.799376 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f1cab77c-2435-419b-ade6-4ece00e1f2b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:08.799818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f1cab77c-2435-419b-ade6-4ece00e1f2b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:08.800235 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f1cab77c-2435-419b-ade6-4ece00e1f2b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:08.949373 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f1cab77c-2435-419b-ade6-4ece00e1f2b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:08.960138 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f1cab77c-2435-419b-ade6-4ece00e1f2b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:08.961894 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f1cab77c-2435-419b-ade6-4ece00e1f2b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:08.963157 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f1cab77c-2435-419b-ade6-4ece00e1f2b1 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.177111 Sep 06 16:26:08.963673 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 553/1129] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:08 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:09.989855 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-32dc4d20-01a4-426a-8410-2844e08168f3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:09.990530 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-32dc4d20-01a4-426a-8410-2844e08168f3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:09.997766 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-32dc4d20-01a4-426a-8410-2844e08168f3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:09.998254 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-32dc4d20-01a4-426a-8410-2844e08168f3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:09.998851 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-32dc4d20-01a4-426a-8410-2844e08168f3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:09.999932 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-32dc4d20-01a4-426a-8410-2844e08168f3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:10.000632 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-32dc4d20-01a4-426a-8410-2844e08168f3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:10.001285 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-32dc4d20-01a4-426a-8410-2844e08168f3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:10.149511 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-32dc4d20-01a4-426a-8410-2844e08168f3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:10.158254 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-32dc4d20-01a4-426a-8410-2844e08168f3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:10.159722 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-32dc4d20-01a4-426a-8410-2844e08168f3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:10.160943 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-32dc4d20-01a4-426a-8410-2844e08168f3 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.175144 Sep 06 16:26:10.161514 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 577/1130] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:09 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:11.187733 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-412fb05c-7cf7-4d86-9b5e-84c8daf22178 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:11.188397 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-412fb05c-7cf7-4d86-9b5e-84c8daf22178 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:11.190763 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=38 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:11.196433 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-412fb05c-7cf7-4d86-9b5e-84c8daf22178 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:11.196969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-412fb05c-7cf7-4d86-9b5e-84c8daf22178 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:11.197412 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-412fb05c-7cf7-4d86-9b5e-84c8daf22178 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:11.198090 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-412fb05c-7cf7-4d86-9b5e-84c8daf22178 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:11.198543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-412fb05c-7cf7-4d86-9b5e-84c8daf22178 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:11.198964 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-412fb05c-7cf7-4d86-9b5e-84c8daf22178 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:11.347150 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-412fb05c-7cf7-4d86-9b5e-84c8daf22178 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:11.355768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-412fb05c-7cf7-4d86-9b5e-84c8daf22178 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:11.357237 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-412fb05c-7cf7-4d86-9b5e-84c8daf22178 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:11.358423 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-412fb05c-7cf7-4d86-9b5e-84c8daf22178 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.175358 Sep 06 16:26:11.359154 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 554/1131] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:11 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:12.384277 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9fe9f4ff-c024-4221-8a20-e6e9eec2298a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:12.384933 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9fe9f4ff-c024-4221-8a20-e6e9eec2298a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:12.391874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9fe9f4ff-c024-4221-8a20-e6e9eec2298a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:12.392352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9fe9f4ff-c024-4221-8a20-e6e9eec2298a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:12.392769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9fe9f4ff-c024-4221-8a20-e6e9eec2298a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:12.393508 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9fe9f4ff-c024-4221-8a20-e6e9eec2298a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:12.393949 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9fe9f4ff-c024-4221-8a20-e6e9eec2298a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:12.394362 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9fe9f4ff-c024-4221-8a20-e6e9eec2298a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:12.532782 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9fe9f4ff-c024-4221-8a20-e6e9eec2298a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:12.541085 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9fe9f4ff-c024-4221-8a20-e6e9eec2298a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:12.542511 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9fe9f4ff-c024-4221-8a20-e6e9eec2298a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:12.543672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9fe9f4ff-c024-4221-8a20-e6e9eec2298a tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.163468 Sep 06 16:26:12.544229 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 578/1132] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:12 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:13.569823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a79be8ba-7d16-4802-a6b5-fcbe6184b8bd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:13.570450 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a79be8ba-7d16-4802-a6b5-fcbe6184b8bd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:13.577406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a79be8ba-7d16-4802-a6b5-fcbe6184b8bd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:13.577875 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a79be8ba-7d16-4802-a6b5-fcbe6184b8bd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:13.578304 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a79be8ba-7d16-4802-a6b5-fcbe6184b8bd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:13.578995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a79be8ba-7d16-4802-a6b5-fcbe6184b8bd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:13.579440 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a79be8ba-7d16-4802-a6b5-fcbe6184b8bd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:13.579892 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a79be8ba-7d16-4802-a6b5-fcbe6184b8bd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:13.712541 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a79be8ba-7d16-4802-a6b5-fcbe6184b8bd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:13.721974 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a79be8ba-7d16-4802-a6b5-fcbe6184b8bd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:13.723500 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a79be8ba-7d16-4802-a6b5-fcbe6184b8bd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:13.724636 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a79be8ba-7d16-4802-a6b5-fcbe6184b8bd tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.158963 Sep 06 16:26:13.725220 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 555/1133] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:13 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:14.754579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f8662b9f-f3f2-448b-909a-a05e914b1943 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:14.755201 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f8662b9f-f3f2-448b-909a-a05e914b1943 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:14.757799 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:14.774537 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f8662b9f-f3f2-448b-909a-a05e914b1943 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:14.775287 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f8662b9f-f3f2-448b-909a-a05e914b1943 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:14.775543 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f8662b9f-f3f2-448b-909a-a05e914b1943 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:14.776677 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f8662b9f-f3f2-448b-909a-a05e914b1943 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:14.777326 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f8662b9f-f3f2-448b-909a-a05e914b1943 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:14.777895 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f8662b9f-f3f2-448b-909a-a05e914b1943 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:14.923292 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f8662b9f-f3f2-448b-909a-a05e914b1943 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:14.932323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f8662b9f-f3f2-448b-909a-a05e914b1943 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:14.933779 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f8662b9f-f3f2-448b-909a-a05e914b1943 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:14.934976 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f8662b9f-f3f2-448b-909a-a05e914b1943 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.187047 Sep 06 16:26:14.935675 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 579/1134] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:14 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:26:15.961520 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-413efe88-89e1-4350-8464-fa20020873a5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:15.962151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-413efe88-89e1-4350-8464-fa20020873a5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:15.969213 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-413efe88-89e1-4350-8464-fa20020873a5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:15.969693 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-413efe88-89e1-4350-8464-fa20020873a5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:15.970122 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-413efe88-89e1-4350-8464-fa20020873a5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:15.970806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-413efe88-89e1-4350-8464-fa20020873a5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:15.971254 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-413efe88-89e1-4350-8464-fa20020873a5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:15.971670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-413efe88-89e1-4350-8464-fa20020873a5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:16.108174 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-413efe88-89e1-4350-8464-fa20020873a5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:16.116678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-413efe88-89e1-4350-8464-fa20020873a5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:16.118153 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-413efe88-89e1-4350-8464-fa20020873a5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:16.119316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-413efe88-89e1-4350-8464-fa20020873a5 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.161838 Sep 06 16:26:16.119886 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 556/1135] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:15 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:17.145243 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3cd79f91-fbe3-44ad-be6b-2b3ef1041e01 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:17.145825 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3cd79f91-fbe3-44ad-be6b-2b3ef1041e01 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:17.152699 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3cd79f91-fbe3-44ad-be6b-2b3ef1041e01 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:17.153234 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3cd79f91-fbe3-44ad-be6b-2b3ef1041e01 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:17.153634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3cd79f91-fbe3-44ad-be6b-2b3ef1041e01 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:17.154469 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3cd79f91-fbe3-44ad-be6b-2b3ef1041e01 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:17.154917 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3cd79f91-fbe3-44ad-be6b-2b3ef1041e01 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:17.155338 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3cd79f91-fbe3-44ad-be6b-2b3ef1041e01 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:17.292656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3cd79f91-fbe3-44ad-be6b-2b3ef1041e01 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:17.302334 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3cd79f91-fbe3-44ad-be6b-2b3ef1041e01 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:17.303787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-3cd79f91-fbe3-44ad-be6b-2b3ef1041e01 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:17.305021 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3cd79f91-fbe3-44ad-be6b-2b3ef1041e01 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.163900 Sep 06 16:26:17.305602 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 580/1136] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:17 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:18.331104 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fb2c78d9-3c3a-42c9-9417-b12bc7c66e0d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:18.331694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fb2c78d9-3c3a-42c9-9417-b12bc7c66e0d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:18.338867 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb2c78d9-3c3a-42c9-9417-b12bc7c66e0d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:18.339351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb2c78d9-3c3a-42c9-9417-b12bc7c66e0d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:18.339784 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb2c78d9-3c3a-42c9-9417-b12bc7c66e0d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:18.340483 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb2c78d9-3c3a-42c9-9417-b12bc7c66e0d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:18.341008 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb2c78d9-3c3a-42c9-9417-b12bc7c66e0d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:18.341458 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb2c78d9-3c3a-42c9-9417-b12bc7c66e0d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:18.477096 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fb2c78d9-3c3a-42c9-9417-b12bc7c66e0d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:18.485696 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fb2c78d9-3c3a-42c9-9417-b12bc7c66e0d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:18.487128 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fb2c78d9-3c3a-42c9-9417-b12bc7c66e0d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:18.488287 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fb2c78d9-3c3a-42c9-9417-b12bc7c66e0d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.161224 Sep 06 16:26:18.488862 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 557/1137] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:18 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:19.514300 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d87023e8-1bdc-491b-91a1-09f23dab59d2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:19.515041 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d87023e8-1bdc-491b-91a1-09f23dab59d2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:19.521478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d87023e8-1bdc-491b-91a1-09f23dab59d2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:19.521959 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d87023e8-1bdc-491b-91a1-09f23dab59d2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:19.522384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d87023e8-1bdc-491b-91a1-09f23dab59d2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:19.523065 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d87023e8-1bdc-491b-91a1-09f23dab59d2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:19.523505 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d87023e8-1bdc-491b-91a1-09f23dab59d2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:19.523895 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d87023e8-1bdc-491b-91a1-09f23dab59d2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:19.544110 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:19.656546 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d87023e8-1bdc-491b-91a1-09f23dab59d2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:19.666376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d87023e8-1bdc-491b-91a1-09f23dab59d2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:19.667809 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d87023e8-1bdc-491b-91a1-09f23dab59d2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:19.669122 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d87023e8-1bdc-491b-91a1-09f23dab59d2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.159093 Sep 06 16:26:19.669844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 581/1138] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:19 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:20.695000 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b8eec2fa-4531-4388-99eb-c3b81a959d51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:20.695593 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b8eec2fa-4531-4388-99eb-c3b81a959d51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:20.702248 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b8eec2fa-4531-4388-99eb-c3b81a959d51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:20.702754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b8eec2fa-4531-4388-99eb-c3b81a959d51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:20.703205 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b8eec2fa-4531-4388-99eb-c3b81a959d51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:20.703914 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b8eec2fa-4531-4388-99eb-c3b81a959d51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:20.704359 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b8eec2fa-4531-4388-99eb-c3b81a959d51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:20.704807 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b8eec2fa-4531-4388-99eb-c3b81a959d51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:20.850833 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b8eec2fa-4531-4388-99eb-c3b81a959d51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:20.861421 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b8eec2fa-4531-4388-99eb-c3b81a959d51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:20.862848 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b8eec2fa-4531-4388-99eb-c3b81a959d51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:20.864242 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b8eec2fa-4531-4388-99eb-c3b81a959d51 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.173458 Sep 06 16:26:20.865054 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 558/1139] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:20 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:21.890807 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-dda0d9f7-7c6c-441c-9e27-0cefc5ee7047 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:21.891446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-dda0d9f7-7c6c-441c-9e27-0cefc5ee7047 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:21.898265 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dda0d9f7-7c6c-441c-9e27-0cefc5ee7047 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:21.898740 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dda0d9f7-7c6c-441c-9e27-0cefc5ee7047 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:21.899175 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dda0d9f7-7c6c-441c-9e27-0cefc5ee7047 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:21.899861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dda0d9f7-7c6c-441c-9e27-0cefc5ee7047 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:21.900310 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dda0d9f7-7c6c-441c-9e27-0cefc5ee7047 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:21.900721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-dda0d9f7-7c6c-441c-9e27-0cefc5ee7047 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:22.046929 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dda0d9f7-7c6c-441c-9e27-0cefc5ee7047 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:22.056413 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dda0d9f7-7c6c-441c-9e27-0cefc5ee7047 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:22.057898 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-dda0d9f7-7c6c-441c-9e27-0cefc5ee7047 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:22.059077 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-dda0d9f7-7c6c-441c-9e27-0cefc5ee7047 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.172283 Sep 06 16:26:22.059817 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 582/1140] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:21 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:23.085603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-90587466-6388-4832-bac3-5018637b7560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:23.086290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-90587466-6388-4832-bac3-5018637b7560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:23.093163 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-90587466-6388-4832-bac3-5018637b7560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:23.093652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-90587466-6388-4832-bac3-5018637b7560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:23.094063 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-90587466-6388-4832-bac3-5018637b7560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:23.094790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-90587466-6388-4832-bac3-5018637b7560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:23.095268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-90587466-6388-4832-bac3-5018637b7560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:23.095695 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-90587466-6388-4832-bac3-5018637b7560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:23.241334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-90587466-6388-4832-bac3-5018637b7560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:23.272995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-90587466-6388-4832-bac3-5018637b7560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:23.275556 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-90587466-6388-4832-bac3-5018637b7560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:23.277863 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-90587466-6388-4832-bac3-5018637b7560 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.196133 Sep 06 16:26:23.293175 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 559/1141] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:23 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:24.319796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-25ac8f6a-9e2b-4815-a862-e4531f55bae0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:24.320363 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-25ac8f6a-9e2b-4815-a862-e4531f55bae0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:24.327310 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-25ac8f6a-9e2b-4815-a862-e4531f55bae0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:24.327789 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-25ac8f6a-9e2b-4815-a862-e4531f55bae0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:24.328210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-25ac8f6a-9e2b-4815-a862-e4531f55bae0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:24.328921 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-25ac8f6a-9e2b-4815-a862-e4531f55bae0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:24.329362 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-25ac8f6a-9e2b-4815-a862-e4531f55bae0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:24.329778 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-25ac8f6a-9e2b-4815-a862-e4531f55bae0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:24.471504 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-25ac8f6a-9e2b-4815-a862-e4531f55bae0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:24.480279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-25ac8f6a-9e2b-4815-a862-e4531f55bae0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:24.481747 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-25ac8f6a-9e2b-4815-a862-e4531f55bae0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:24.482997 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-25ac8f6a-9e2b-4815-a862-e4531f55bae0 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.167225 Sep 06 16:26:24.483617 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 583/1142] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:24 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:25.507955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4870983a-8950-4337-abf4-5f8dd04e697d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:25.508546 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4870983a-8950-4337-abf4-5f8dd04e697d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:25.515570 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4870983a-8950-4337-abf4-5f8dd04e697d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:25.516045 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4870983a-8950-4337-abf4-5f8dd04e697d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:25.516476 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4870983a-8950-4337-abf4-5f8dd04e697d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:25.517196 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4870983a-8950-4337-abf4-5f8dd04e697d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:25.517640 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4870983a-8950-4337-abf4-5f8dd04e697d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:25.518052 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4870983a-8950-4337-abf4-5f8dd04e697d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:25.648000 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4870983a-8950-4337-abf4-5f8dd04e697d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:25.656580 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4870983a-8950-4337-abf4-5f8dd04e697d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:25.658046 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4870983a-8950-4337-abf4-5f8dd04e697d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:25.659189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4870983a-8950-4337-abf4-5f8dd04e697d tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.155317 Sep 06 16:26:25.659777 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 560/1143] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:25 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:26.684775 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-108a44b9-18b1-4a8f-b8ea-5d42ddbea77c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:26.685437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-108a44b9-18b1-4a8f-b8ea-5d42ddbea77c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:26.692203 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-108a44b9-18b1-4a8f-b8ea-5d42ddbea77c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:26.692680 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-108a44b9-18b1-4a8f-b8ea-5d42ddbea77c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:26.693139 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-108a44b9-18b1-4a8f-b8ea-5d42ddbea77c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:26.693819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-108a44b9-18b1-4a8f-b8ea-5d42ddbea77c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:26.694257 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-108a44b9-18b1-4a8f-b8ea-5d42ddbea77c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:26.694672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-108a44b9-18b1-4a8f-b8ea-5d42ddbea77c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:26.833253 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-108a44b9-18b1-4a8f-b8ea-5d42ddbea77c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:26.842017 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-108a44b9-18b1-4a8f-b8ea-5d42ddbea77c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:26.843450 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-108a44b9-18b1-4a8f-b8ea-5d42ddbea77c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:26.844618 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-108a44b9-18b1-4a8f-b8ea-5d42ddbea77c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.163877 Sep 06 16:26:26.845225 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 584/1144] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:26 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:27.870577 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f764c83c-6b76-4f6b-8d64-d16f04dc53af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:27.871155 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f764c83c-6b76-4f6b-8d64-d16f04dc53af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:27.878170 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f764c83c-6b76-4f6b-8d64-d16f04dc53af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:27.878653 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f764c83c-6b76-4f6b-8d64-d16f04dc53af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:27.879086 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f764c83c-6b76-4f6b-8d64-d16f04dc53af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:27.879773 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f764c83c-6b76-4f6b-8d64-d16f04dc53af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:27.880275 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f764c83c-6b76-4f6b-8d64-d16f04dc53af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:27.880690 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f764c83c-6b76-4f6b-8d64-d16f04dc53af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:27.883385 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=76 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:28.026062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f764c83c-6b76-4f6b-8d64-d16f04dc53af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:28.035339 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f764c83c-6b76-4f6b-8d64-d16f04dc53af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:28.037274 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f764c83c-6b76-4f6b-8d64-d16f04dc53af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:28.038614 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f764c83c-6b76-4f6b-8d64-d16f04dc53af tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.171958 Sep 06 16:26:28.040692 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 561/1145] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:27 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:28.166738 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-c7d17804-7dd2-49e4-b2a4-1d4882e8abe3 req-466a5710-3a78-4c20-900a-847503ab46c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5393a1be-4392-48fb-b317-79525e0639b6", "name": "network-vif-plugged", "status": "completed", "tag": "871e4881-cbaf-4c42-8c18-28566def207e"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:26:28.180727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c7d17804-7dd2-49e4-b2a4-1d4882e8abe3 req-466a5710-3a78-4c20-900a-847503ab46c3 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:28.181413 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c7d17804-7dd2-49e4-b2a4-1d4882e8abe3 req-466a5710-3a78-4c20-900a-847503ab46c3 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:28.182175 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c7d17804-7dd2-49e4-b2a4-1d4882e8abe3 req-466a5710-3a78-4c20-900a-847503ab46c3 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:28.195586 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-c7d17804-7dd2-49e4-b2a4-1d4882e8abe3 req-466a5710-3a78-4c20-900a-847503ab46c3 service nova] Creating event network-vif-plugged:871e4881-cbaf-4c42-8c18-28566def207e for instance 5393a1be-4392-48fb-b317-79525e0639b6 on hv-cinder-85221 Sep 06 16:26:28.201315 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-c7d17804-7dd2-49e4-b2a4-1d4882e8abe3 req-466a5710-3a78-4c20-900a-847503ab46c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039522 Sep 06 16:26:28.201923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 585/1146] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:26:29.065207 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-abfe7fdb-34ba-473b-961c-1a6c73c113bf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:29.065947 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-abfe7fdb-34ba-473b-961c-1a6c73c113bf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:29.072872 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-abfe7fdb-34ba-473b-961c-1a6c73c113bf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:29.073356 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-abfe7fdb-34ba-473b-961c-1a6c73c113bf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:29.073786 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-abfe7fdb-34ba-473b-961c-1a6c73c113bf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:29.074475 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-abfe7fdb-34ba-473b-961c-1a6c73c113bf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:29.074917 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-abfe7fdb-34ba-473b-961c-1a6c73c113bf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:29.075337 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-abfe7fdb-34ba-473b-961c-1a6c73c113bf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:29.212053 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-abfe7fdb-34ba-473b-961c-1a6c73c113bf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:29.220792 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-abfe7fdb-34ba-473b-961c-1a6c73c113bf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:29.222225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-abfe7fdb-34ba-473b-961c-1a6c73c113bf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:29.223384 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-abfe7fdb-34ba-473b-961c-1a6c73c113bf tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.162244 Sep 06 16:26:29.223943 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 562/1147] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:29 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:30.251473 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-db426239-550d-48de-91b7-68a007ccc28f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:30.252049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-db426239-550d-48de-91b7-68a007ccc28f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:30.258943 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db426239-550d-48de-91b7-68a007ccc28f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:30.259418 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db426239-550d-48de-91b7-68a007ccc28f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:30.259844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db426239-550d-48de-91b7-68a007ccc28f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:30.260531 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db426239-550d-48de-91b7-68a007ccc28f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:30.261014 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db426239-550d-48de-91b7-68a007ccc28f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:30.261430 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-db426239-550d-48de-91b7-68a007ccc28f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:30.397127 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-db426239-550d-48de-91b7-68a007ccc28f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:30.405763 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-db426239-550d-48de-91b7-68a007ccc28f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:30.407168 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-db426239-550d-48de-91b7-68a007ccc28f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:30.408338 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-db426239-550d-48de-91b7-68a007ccc28f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.161892 Sep 06 16:26:30.408939 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 586/1148] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:30 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:31.437326 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d15a07a2-a10c-4498-afd2-cae227e50a46 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:31.438148 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d15a07a2-a10c-4498-afd2-cae227e50a46 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:31.446535 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d15a07a2-a10c-4498-afd2-cae227e50a46 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:31.447031 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d15a07a2-a10c-4498-afd2-cae227e50a46 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:31.447470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d15a07a2-a10c-4498-afd2-cae227e50a46 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:31.448188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d15a07a2-a10c-4498-afd2-cae227e50a46 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:31.448641 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d15a07a2-a10c-4498-afd2-cae227e50a46 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:31.449267 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d15a07a2-a10c-4498-afd2-cae227e50a46 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:31.600201 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d15a07a2-a10c-4498-afd2-cae227e50a46 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:31.610613 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d15a07a2-a10c-4498-afd2-cae227e50a46 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:31.612077 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d15a07a2-a10c-4498-afd2-cae227e50a46 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:31.613277 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d15a07a2-a10c-4498-afd2-cae227e50a46 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1730 microversion: 2.20 time: 0.183053 Sep 06 16:26:31.613890 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 563/1149] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:31 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:32.639696 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0fa7ac7a-1976-4da0-8395-f0f3d3f6ac0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:32.640354 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0fa7ac7a-1976-4da0-8395-f0f3d3f6ac0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:32.647272 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0fa7ac7a-1976-4da0-8395-f0f3d3f6ac0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:32.647761 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0fa7ac7a-1976-4da0-8395-f0f3d3f6ac0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:32.648192 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0fa7ac7a-1976-4da0-8395-f0f3d3f6ac0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:32.649328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0fa7ac7a-1976-4da0-8395-f0f3d3f6ac0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:32.649328 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0fa7ac7a-1976-4da0-8395-f0f3d3f6ac0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:32.649763 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0fa7ac7a-1976-4da0-8395-f0f3d3f6ac0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:32.779815 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0fa7ac7a-1976-4da0-8395-f0f3d3f6ac0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:32.788427 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0fa7ac7a-1976-4da0-8395-f0f3d3f6ac0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:32.789906 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0fa7ac7a-1976-4da0-8395-f0f3d3f6ac0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:32.791047 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0fa7ac7a-1976-4da0-8395-f0f3d3f6ac0c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1717 microversion: 2.20 time: 0.155486 Sep 06 16:26:32.791600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 587/1150] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:32 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:56.842917 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=19 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:56.843676 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=17 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:57.108022 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c20e241f-a0cb-4fc5-a70c-dae9308a53df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:57.108512 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c20e241f-a0cb-4fc5-a70c-dae9308a53df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:57.114697 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c20e241f-a0cb-4fc5-a70c-dae9308a53df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:57.115165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c20e241f-a0cb-4fc5-a70c-dae9308a53df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:57.115600 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c20e241f-a0cb-4fc5-a70c-dae9308a53df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:57.116294 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c20e241f-a0cb-4fc5-a70c-dae9308a53df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:57.116745 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c20e241f-a0cb-4fc5-a70c-dae9308a53df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:57.117186 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c20e241f-a0cb-4fc5-a70c-dae9308a53df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:57.140632 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c20e241f-a0cb-4fc5-a70c-dae9308a53df tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/ips" status: 200 len: 147 microversion: 2.1 time: 0.303696 Sep 06 16:26:57.141233 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 564/1151] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 6 16:26:56 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/ips => generated 147 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:26:58.495128 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1f7103e7-bb15-4351-9c5c-a1ece602fc5f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62767ab9-5907-4f2c-8d6b-c34dc00c1aa3"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:26:58.497672 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1f7103e7-bb15-4351-9c5c-a1ece602fc5f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:58.500150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=17 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:58.501018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=34 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:58.506877 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f7103e7-bb15-4351-9c5c-a1ece602fc5f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:58.507364 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f7103e7-bb15-4351-9c5c-a1ece602fc5f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:58.507792 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f7103e7-bb15-4351-9c5c-a1ece602fc5f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:58.508641 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f7103e7-bb15-4351-9c5c-a1ece602fc5f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:58.509266 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f7103e7-bb15-4351-9c5c-a1ece602fc5f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:58.509540 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1f7103e7-bb15-4351-9c5c-a1ece602fc5f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:58.796484 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1f7103e7-bb15-4351-9c5c-a1ece602fc5f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "POST /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305242 Sep 06 16:26:58.797071 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 588/1152] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:26:58 2022] POST /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:06.401434 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3400d507-6595-41af-a8c4-7574e33f1688 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:06.403785 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-3400d507-6595-41af-a8c4-7574e33f1688 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:06.412209 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3400d507-6595-41af-a8c4-7574e33f1688 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:06.412681 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3400d507-6595-41af-a8c4-7574e33f1688 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:06.413148 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3400d507-6595-41af-a8c4-7574e33f1688 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:06.413853 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3400d507-6595-41af-a8c4-7574e33f1688 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:06.414304 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3400d507-6595-41af-a8c4-7574e33f1688 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:06.414728 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3400d507-6595-41af-a8c4-7574e33f1688 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:06.447187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-3400d507-6595-41af-a8c4-7574e33f1688 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050429 Sep 06 16:27:06.447743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 565/1153] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:27:06 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:06.460135 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7ef0c3a0-b313-46b3-8467-f9f15fd806a2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:06.460691 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7ef0c3a0-b313-46b3-8467-f9f15fd806a2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:06.467511 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7ef0c3a0-b313-46b3-8467-f9f15fd806a2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:06.467990 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7ef0c3a0-b313-46b3-8467-f9f15fd806a2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:06.468413 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7ef0c3a0-b313-46b3-8467-f9f15fd806a2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:06.469131 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7ef0c3a0-b313-46b3-8467-f9f15fd806a2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:06.469575 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7ef0c3a0-b313-46b3-8467-f9f15fd806a2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:06.469991 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7ef0c3a0-b313-46b3-8467-f9f15fd806a2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:06.504374 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7ef0c3a0-b313-46b3-8467-f9f15fd806a2 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments/62767ab9-5907-4f2c-8d6b-c34dc00c1aa3" status: 200 len: 194 microversion: 2.1 time: 0.049038 Sep 06 16:27:06.505010 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 589/1154] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Sep 6 16:27:06 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments/62767ab9-5907-4f2c-8d6b-c34dc00c1aa3 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:07.890404 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9659831e-2698-4dd2-8751-9f1e7ea9d83b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "948e56ae-e773-4d72-b28e-4dc8ffe71021"}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:07.892799 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9659831e-2698-4dd2-8751-9f1e7ea9d83b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:07.900107 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9659831e-2698-4dd2-8751-9f1e7ea9d83b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:07.900822 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9659831e-2698-4dd2-8751-9f1e7ea9d83b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:07.901228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9659831e-2698-4dd2-8751-9f1e7ea9d83b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:07.901924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9659831e-2698-4dd2-8751-9f1e7ea9d83b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:07.902368 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9659831e-2698-4dd2-8751-9f1e7ea9d83b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:07.902787 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9659831e-2698-4dd2-8751-9f1e7ea9d83b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:08.197170 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9659831e-2698-4dd2-8751-9f1e7ea9d83b tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "POST /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310457 Sep 06 16:27:08.197937 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 566/1155] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:27:07 2022] POST /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:15.804980 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-33e3539c-db78-423c-b1a6-e2f40a72b225 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:15.807337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-33e3539c-db78-423c-b1a6-e2f40a72b225 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:15.814039 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-33e3539c-db78-423c-b1a6-e2f40a72b225 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:15.814524 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-33e3539c-db78-423c-b1a6-e2f40a72b225 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:15.814949 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-33e3539c-db78-423c-b1a6-e2f40a72b225 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:15.815633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-33e3539c-db78-423c-b1a6-e2f40a72b225 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:15.816076 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-33e3539c-db78-423c-b1a6-e2f40a72b225 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:15.816491 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-33e3539c-db78-423c-b1a6-e2f40a72b225 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:15.854800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-33e3539c-db78-423c-b1a6-e2f40a72b225 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056752 Sep 06 16:27:15.855363 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 590/1156] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:27:15 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:15.999412 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b3cc17d8-b41f-4130-80cd-d207688b4d86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:16.000008 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b3cc17d8-b41f-4130-80cd-d207688b4d86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:16.006565 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b3cc17d8-b41f-4130-80cd-d207688b4d86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:16.007050 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b3cc17d8-b41f-4130-80cd-d207688b4d86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:16.007511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b3cc17d8-b41f-4130-80cd-d207688b4d86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:16.008179 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b3cc17d8-b41f-4130-80cd-d207688b4d86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:16.008631 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b3cc17d8-b41f-4130-80cd-d207688b4d86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:16.009155 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b3cc17d8-b41f-4130-80cd-d207688b4d86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:16.040189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b3cc17d8-b41f-4130-80cd-d207688b4d86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments/62767ab9-5907-4f2c-8d6b-c34dc00c1aa3" status: 200 len: 194 microversion: 2.1 time: 0.045552 Sep 06 16:27:16.040774 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 567/1157] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Sep 6 16:27:15 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments/62767ab9-5907-4f2c-8d6b-c34dc00c1aa3 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:16.051875 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-aa93a5e2-5711-4950-990d-a39be49ed859 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:16.052440 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-aa93a5e2-5711-4950-990d-a39be49ed859 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:16.058846 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-aa93a5e2-5711-4950-990d-a39be49ed859 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:16.059326 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-aa93a5e2-5711-4950-990d-a39be49ed859 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:16.059753 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-aa93a5e2-5711-4950-990d-a39be49ed859 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:16.060434 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-aa93a5e2-5711-4950-990d-a39be49ed859 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:16.060915 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-aa93a5e2-5711-4950-990d-a39be49ed859 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:16.061337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-aa93a5e2-5711-4950-990d-a39be49ed859 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:16.144813 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-aa93a5e2-5711-4950-990d-a39be49ed859 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lazy-loading 'services' on Instance uuid a39987c5-d718-40b4-804f-328144e58e8b {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:16.237671 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-aa93a5e2-5711-4950-990d-a39be49ed859 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments/62767ab9-5907-4f2c-8d6b-c34dc00c1aa3" status: 202 len: 0 microversion: 2.1 time: 0.189963 Sep 06 16:27:16.238252 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 591/1158] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 6 16:27:16 2022] DELETE /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments/62767ab9-5907-4f2c-8d6b-c34dc00c1aa3 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:27:18.439107 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-84587100-67c6-4d3b-8798-c5d591de1e86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:18.439637 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-84587100-67c6-4d3b-8798-c5d591de1e86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:18.446889 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-84587100-67c6-4d3b-8798-c5d591de1e86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:18.447375 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-84587100-67c6-4d3b-8798-c5d591de1e86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:18.447811 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-84587100-67c6-4d3b-8798-c5d591de1e86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:18.448510 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-84587100-67c6-4d3b-8798-c5d591de1e86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:18.449015 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-84587100-67c6-4d3b-8798-c5d591de1e86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:18.449444 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-84587100-67c6-4d3b-8798-c5d591de1e86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:18.480425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-84587100-67c6-4d3b-8798-c5d591de1e86 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments/948e56ae-e773-4d72-b28e-4dc8ffe71021" status: 200 len: 194 microversion: 2.1 time: 0.045439 Sep 06 16:27:18.481044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 568/1159] 10.222.0.43 () {58 vars in 1413 bytes} [Tue Sep 6 16:27:18 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments/948e56ae-e773-4d72-b28e-4dc8ffe71021 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:18.493034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e0419e32-27c5-41d4-ad2a-6ed322f9c61a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:18.493557 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e0419e32-27c5-41d4-ad2a-6ed322f9c61a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:18.500084 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e0419e32-27c5-41d4-ad2a-6ed322f9c61a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:18.500571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e0419e32-27c5-41d4-ad2a-6ed322f9c61a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:18.501040 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e0419e32-27c5-41d4-ad2a-6ed322f9c61a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:18.501731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e0419e32-27c5-41d4-ad2a-6ed322f9c61a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:18.502181 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e0419e32-27c5-41d4-ad2a-6ed322f9c61a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:18.502601 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e0419e32-27c5-41d4-ad2a-6ed322f9c61a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:18.585653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-e0419e32-27c5-41d4-ad2a-6ed322f9c61a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lazy-loading 'services' on Instance uuid a39987c5-d718-40b4-804f-328144e58e8b {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:18.668704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e0419e32-27c5-41d4-ad2a-6ed322f9c61a tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments/948e56ae-e773-4d72-b28e-4dc8ffe71021" status: 202 len: 0 microversion: 2.1 time: 0.180400 Sep 06 16:27:18.669367 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 592/1160] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 6 16:27:18 2022] DELETE /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments/948e56ae-e773-4d72-b28e-4dc8ffe71021 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:27:19.855308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-98602176-f16d-495c-8efe-d2cd4f1c557f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:19.858073 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-98602176-f16d-495c-8efe-d2cd4f1c557f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:19.864898 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-98602176-f16d-495c-8efe-d2cd4f1c557f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:19.865386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-98602176-f16d-495c-8efe-d2cd4f1c557f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:19.865857 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-98602176-f16d-495c-8efe-d2cd4f1c557f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:19.866708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-98602176-f16d-495c-8efe-d2cd4f1c557f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:19.867166 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-98602176-f16d-495c-8efe-d2cd4f1c557f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:19.867592 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-98602176-f16d-495c-8efe-d2cd4f1c557f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:19.899138 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-98602176-f16d-495c-8efe-d2cd4f1c557f tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050374 Sep 06 16:27:19.899584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 569/1161] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:27:19 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:27:20.021247 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-035e5161-3dc3-4f40-a9bd-9437c85e7c45 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:20.023623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-035e5161-3dc3-4f40-a9bd-9437c85e7c45 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:20.030553 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-035e5161-3dc3-4f40-a9bd-9437c85e7c45 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:20.031030 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-035e5161-3dc3-4f40-a9bd-9437c85e7c45 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:20.031456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-035e5161-3dc3-4f40-a9bd-9437c85e7c45 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:20.032139 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-035e5161-3dc3-4f40-a9bd-9437c85e7c45 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:20.032584 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-035e5161-3dc3-4f40-a9bd-9437c85e7c45 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:20.033033 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-035e5161-3dc3-4f40-a9bd-9437c85e7c45 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:20.062314 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-035e5161-3dc3-4f40-a9bd-9437c85e7c45 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045465 Sep 06 16:27:20.062864 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 593/1162] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:27:20 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:27:20.145749 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-35b26b5a-c39c-4a8e-9127-ec4dfea241ee tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:20.146240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-35b26b5a-c39c-4a8e-9127-ec4dfea241ee tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:20.152695 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35b26b5a-c39c-4a8e-9127-ec4dfea241ee tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:20.153150 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35b26b5a-c39c-4a8e-9127-ec4dfea241ee tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:20.153581 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35b26b5a-c39c-4a8e-9127-ec4dfea241ee tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:20.154341 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35b26b5a-c39c-4a8e-9127-ec4dfea241ee tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:20.154790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35b26b5a-c39c-4a8e-9127-ec4dfea241ee tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:20.155274 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35b26b5a-c39c-4a8e-9127-ec4dfea241ee tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:20.181335 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-35b26b5a-c39c-4a8e-9127-ec4dfea241ee tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Going to try to terminate instance {{(pid=120669) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:27:20.264956 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-35b26b5a-c39c-4a8e-9127-ec4dfea241ee tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 204 len: 0 microversion: 2.1 time: 0.123410 Sep 06 16:27:20.265805 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 570/1163] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:27:20 2022] DELETE /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:27:20.274827 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2cc781e2-442c-4bad-b060-06b300308e15 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:20.275437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2cc781e2-442c-4bad-b060-06b300308e15 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:20.281843 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2cc781e2-442c-4bad-b060-06b300308e15 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:20.282327 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2cc781e2-442c-4bad-b060-06b300308e15 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:20.282756 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2cc781e2-442c-4bad-b060-06b300308e15 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:20.283477 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2cc781e2-442c-4bad-b060-06b300308e15 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:20.283925 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2cc781e2-442c-4bad-b060-06b300308e15 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:20.284341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2cc781e2-442c-4bad-b060-06b300308e15 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:20.421375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2cc781e2-442c-4bad-b060-06b300308e15 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:20.430171 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2cc781e2-442c-4bad-b060-06b300308e15 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1674 microversion: 2.1 time: 0.159669 Sep 06 16:27:20.430742 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 594/1164] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:20 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:21.453258 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-57902d19-f183-464d-adb1-4a2b5293f6e6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:21.453947 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-57902d19-f183-464d-adb1-4a2b5293f6e6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:21.460799 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57902d19-f183-464d-adb1-4a2b5293f6e6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:21.461308 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57902d19-f183-464d-adb1-4a2b5293f6e6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:21.461734 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57902d19-f183-464d-adb1-4a2b5293f6e6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:21.462419 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57902d19-f183-464d-adb1-4a2b5293f6e6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:21.462863 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57902d19-f183-464d-adb1-4a2b5293f6e6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:21.463277 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-57902d19-f183-464d-adb1-4a2b5293f6e6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:21.596140 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-57902d19-f183-464d-adb1-4a2b5293f6e6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:21.608406 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-57902d19-f183-464d-adb1-4a2b5293f6e6 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1674 microversion: 2.1 time: 0.159272 Sep 06 16:27:21.609290 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 571/1165] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:21 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:22.640206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-93064676-474d-45ca-baa8-1168c319e42c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:22.640923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-93064676-474d-45ca-baa8-1168c319e42c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:22.648520 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93064676-474d-45ca-baa8-1168c319e42c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:22.649138 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93064676-474d-45ca-baa8-1168c319e42c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:22.649633 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93064676-474d-45ca-baa8-1168c319e42c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:22.650417 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93064676-474d-45ca-baa8-1168c319e42c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:22.650951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93064676-474d-45ca-baa8-1168c319e42c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:22.651472 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93064676-474d-45ca-baa8-1168c319e42c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:22.787051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-93064676-474d-45ca-baa8-1168c319e42c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:22.795266 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-93064676-474d-45ca-baa8-1168c319e42c tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1674 microversion: 2.1 time: 0.160616 Sep 06 16:27:22.795840 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 595/1166] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:22 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:23.573800 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-f483ee1e-5dd0-424e-aa99-548ca7955a82 req-f1881381-ae34-4fee-8fe1-0bb35db58fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a39987c5-d718-40b4-804f-328144e58e8b", "name": "network-vif-deleted", "tag": "d0c9b9f7-0d8c-4c96-8253-1d2ea33d8104"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:23.587509 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-f483ee1e-5dd0-424e-aa99-548ca7955a82 req-f1881381-ae34-4fee-8fe1-0bb35db58fe8 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:23.588665 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-f483ee1e-5dd0-424e-aa99-548ca7955a82 req-f1881381-ae34-4fee-8fe1-0bb35db58fe8 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:23.589316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-f483ee1e-5dd0-424e-aa99-548ca7955a82 req-f1881381-ae34-4fee-8fe1-0bb35db58fe8 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:23.606960 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-f483ee1e-5dd0-424e-aa99-548ca7955a82 req-f1881381-ae34-4fee-8fe1-0bb35db58fe8 service nova] Creating event network-vif-deleted:d0c9b9f7-0d8c-4c96-8253-1d2ea33d8104 for instance a39987c5-d718-40b4-804f-328144e58e8b on hv-cinder-85221 Sep 06 16:27:23.612905 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-f483ee1e-5dd0-424e-aa99-548ca7955a82 req-f1881381-ae34-4fee-8fe1-0bb35db58fe8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105370 Sep 06 16:27:23.616932 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 572/1167] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:23.818273 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:23.818805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:23.825589 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:23.826271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:23.826870 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:23.827761 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:23.828366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:23.828982 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:23.862692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:23.863091 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:23.863521 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:23.863956 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lazy-loading 'fault' on Instance uuid a39987c5-d718-40b4-804f-328144e58e8b {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:23.905375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225aec64aee47449542aecbec0ae561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0bef00a05c4029a009992a7f96fa80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:23.913377 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1e7386fa-4492-43c6-a9d2-25f2cd61f703 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 200 len: 1326 microversion: 2.1 time: 0.098851 Sep 06 16:27:23.913948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 596/1168] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:23 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:24.944141 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3cef0279-4624-4196-b4c4-d6c651e336a7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:24.945134 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-3cef0279-4624-4196-b4c4-d6c651e336a7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:24.953316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3cef0279-4624-4196-b4c4-d6c651e336a7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:24.954163 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3cef0279-4624-4196-b4c4-d6c651e336a7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:24.954908 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3cef0279-4624-4196-b4c4-d6c651e336a7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:24.955593 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3cef0279-4624-4196-b4c4-d6c651e336a7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:24.956072 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3cef0279-4624-4196-b4c4-d6c651e336a7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:24.956486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-3cef0279-4624-4196-b4c4-d6c651e336a7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:24.971928 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-3cef0279-4624-4196-b4c4-d6c651e336a7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] HTTP exception thrown: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3cef0279-4624-4196-b4c4-d6c651e336a7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Request method failure captured: Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b HTTP/1.1 Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3I7XZAP2rEccRH17orHIdnfGI8mYnSWwhrkcF5L1jIXCtcR_IaNpMNh5npnj8_7Z-b3weCNmmzz3eWc0RpjJ9AUHU9C3oeZy3sGVHsmGEXrDIuh6njoiHyk2a0tU4QTXOebrg73HxMMtpON7bgVW_kGjMHlGIn8ODmFx-sseZ3p_kw Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: ad0bef00a05c4029a009992a7f96fa80 Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:27:24.973607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:27:24.975239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:27:24.975239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:24.975239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: ad0bef00a05c4029a009992a7f96fa80 Sep 06 16:27:24.975239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:24.975239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-AttachVolumeTestJSON-1420528339-project Sep 06 16:27:24.975239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:27:24.975239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:27:24.975239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: e225aec64aee47449542aecbec0ae561 Sep 06 16:27:24.975239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-AttachVolumeTestJSON-1420528339-project Sep 06 16:27:24.975239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:27:24.975239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:24.975239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'a39987c5-d718-40b4-804f-328144e58e8b'} Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:24.976185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:24.977783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:24.979217 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-3cef0279-4624-4196-b4c4-d6c651e336a7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Returning 404 to user: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:24.979217 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-3cef0279-4624-4196-b4c4-d6c651e336a7 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 404 len: 111 microversion: 2.1 time: 0.037426 Sep 06 16:27:24.979217 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 573/1169] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:24 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:24.985666 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-8f3ac5ed-b2fe-448e-aa52-0b5ff84844a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '.version_select at 0x7f83e95c9790>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:25.007680 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-8f3ac5ed-b2fe-448e-aa52-0b5ff84844a0 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-856832064" status: 202 len: 0 microversion: 2.1 time: 0.026314 Sep 06 16:27:25.008154 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 597/1170] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Sep 6 16:27:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-856832064 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:27:25.518205 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f8c2b721-00be-4786-8ecb-5de11e5fcc1e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:25.518732 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f8c2b721-00be-4786-8ecb-5de11e5fcc1e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:25.525130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f8c2b721-00be-4786-8ecb-5de11e5fcc1e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:25.525644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f8c2b721-00be-4786-8ecb-5de11e5fcc1e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:25.526060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f8c2b721-00be-4786-8ecb-5de11e5fcc1e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:25.526763 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f8c2b721-00be-4786-8ecb-5de11e5fcc1e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:25.527209 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f8c2b721-00be-4786-8ecb-5de11e5fcc1e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:25.527685 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f8c2b721-00be-4786-8ecb-5de11e5fcc1e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:25.553794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-f8c2b721-00be-4786-8ecb-5de11e5fcc1e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lazy-loading 'flavor' on Instance uuid 993ac4a3-a4e1-43cb-b6da-af83833f1396 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:25.633549 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f8c2b721-00be-4786-8ecb-5de11e5fcc1e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "POST /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396/action" status: 202 len: 0 microversion: 2.1 time: 0.119149 Sep 06 16:27:25.634130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 574/1171] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:27:25 2022] POST /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:27:25.645352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b163589b-f76a-42fa-a459-bc9591f6688a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:25.646074 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b163589b-f76a-42fa-a459-bc9591f6688a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:25.653264 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b163589b-f76a-42fa-a459-bc9591f6688a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:25.654042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b163589b-f76a-42fa-a459-bc9591f6688a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:25.654528 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b163589b-f76a-42fa-a459-bc9591f6688a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:25.655304 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b163589b-f76a-42fa-a459-bc9591f6688a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:25.655751 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b163589b-f76a-42fa-a459-bc9591f6688a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:25.656204 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b163589b-f76a-42fa-a459-bc9591f6688a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:25.789632 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b163589b-f76a-42fa-a459-bc9591f6688a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:25.798147 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b163589b-f76a-42fa-a459-bc9591f6688a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.158083 Sep 06 16:27:25.798931 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 598/1172] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:25 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:26.828004 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-381c33f4-f89e-4b36-af51-c077c933d394 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:26.829165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-381c33f4-f89e-4b36-af51-c077c933d394 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:26.840483 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-381c33f4-f89e-4b36-af51-c077c933d394 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:26.841334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-381c33f4-f89e-4b36-af51-c077c933d394 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:26.842045 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-381c33f4-f89e-4b36-af51-c077c933d394 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:26.842981 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-381c33f4-f89e-4b36-af51-c077c933d394 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:26.843428 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-381c33f4-f89e-4b36-af51-c077c933d394 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:26.843847 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-381c33f4-f89e-4b36-af51-c077c933d394 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:26.859008 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:26.984919 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-381c33f4-f89e-4b36-af51-c077c933d394 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:26.993142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-381c33f4-f89e-4b36-af51-c077c933d394 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.172272 Sep 06 16:27:26.993726 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 575/1173] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:26 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:28.021575 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b89bff38-c5a1-470c-b2c4-3a3fe0b42c2c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:28.022186 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b89bff38-c5a1-470c-b2c4-3a3fe0b42c2c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:28.029073 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b89bff38-c5a1-470c-b2c4-3a3fe0b42c2c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:28.029561 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b89bff38-c5a1-470c-b2c4-3a3fe0b42c2c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:28.029979 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b89bff38-c5a1-470c-b2c4-3a3fe0b42c2c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:28.030690 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b89bff38-c5a1-470c-b2c4-3a3fe0b42c2c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:28.031142 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b89bff38-c5a1-470c-b2c4-3a3fe0b42c2c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:28.031564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b89bff38-c5a1-470c-b2c4-3a3fe0b42c2c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:28.168073 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b89bff38-c5a1-470c-b2c4-3a3fe0b42c2c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:28.177015 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b89bff38-c5a1-470c-b2c4-3a3fe0b42c2c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.159855 Sep 06 16:27:28.177565 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 599/1174] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:28 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:28.205177 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-35dd6c46-665b-4243-9068-08900597dfaa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:28.205686 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-35dd6c46-665b-4243-9068-08900597dfaa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:28.208202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:28.213618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35dd6c46-665b-4243-9068-08900597dfaa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:28.214158 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35dd6c46-665b-4243-9068-08900597dfaa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:28.214596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35dd6c46-665b-4243-9068-08900597dfaa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:28.215295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35dd6c46-665b-4243-9068-08900597dfaa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:28.215747 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35dd6c46-665b-4243-9068-08900597dfaa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:28.216168 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-35dd6c46-665b-4243-9068-08900597dfaa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:28.230927 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-35dd6c46-665b-4243-9068-08900597dfaa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] HTTP exception thrown: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-35dd6c46-665b-4243-9068-08900597dfaa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Request method failure captured: Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: DELETE /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b HTTP/1.1 Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3I7XZAP2rEccRH17orHIdnfGI8mYnSWwhrkcF5L1jIXCtcR_IaNpMNh5npnj8_7Z-b3weCNmmzz3eWc0RpjJ9AUHU9C3oeZy3sGVHsmGEXrDIuh6njoiHyk2a0tU4QTXOebrg73HxMMtpON7bgVW_kGjMHlGIn8ODmFx-sseZ3p_kw Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: ad0bef00a05c4029a009992a7f96fa80 Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:27:28.232618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:27:28.234286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:27:28.234286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:28.234286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: ad0bef00a05c4029a009992a7f96fa80 Sep 06 16:27:28.234286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:28.234286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-AttachVolumeTestJSON-1420528339-project Sep 06 16:27:28.234286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:27:28.234286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:27:28.234286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: e225aec64aee47449542aecbec0ae561 Sep 06 16:27:28.234286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-AttachVolumeTestJSON-1420528339-project Sep 06 16:27:28.234286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:27:28.234286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:28.234286 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'a39987c5-d718-40b4-804f-328144e58e8b'} Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:28.235495 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:28.237062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:28.238590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-35dd6c46-665b-4243-9068-08900597dfaa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Returning 404 to user: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:28.238590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-35dd6c46-665b-4243-9068-08900597dfaa tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 404 len: 111 microversion: 2.1 time: 0.032938 Sep 06 16:27:28.238590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 576/1175] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:27:28 2022] DELETE /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:28.242785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e0e72097-ea6d-41af-af61-6109eadbcdcc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:28.243366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e0e72097-ea6d-41af-af61-6109eadbcdcc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: a39987c5-d718-40b4-804f-328144e58e8b] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:28.249509 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e0e72097-ea6d-41af-af61-6109eadbcdcc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:28.249978 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e0e72097-ea6d-41af-af61-6109eadbcdcc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:28.250405 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e0e72097-ea6d-41af-af61-6109eadbcdcc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:28.251108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e0e72097-ea6d-41af-af61-6109eadbcdcc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:28.251545 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e0e72097-ea6d-41af-af61-6109eadbcdcc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:28.251956 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e0e72097-ea6d-41af-af61-6109eadbcdcc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:28.266211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-e0e72097-ea6d-41af-af61-6109eadbcdcc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] HTTP exception thrown: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e0e72097-ea6d-41af-af61-6109eadbcdcc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Request method failure captured: Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b HTTP/1.1 Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3I7XZAP2rEccRH17orHIdnfGI8mYnSWwhrkcF5L1jIXCtcR_IaNpMNh5npnj8_7Z-b3weCNmmzz3eWc0RpjJ9AUHU9C3oeZy3sGVHsmGEXrDIuh6njoiHyk2a0tU4QTXOebrg73HxMMtpON7bgVW_kGjMHlGIn8ODmFx-sseZ3p_kw Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: ad0bef00a05c4029a009992a7f96fa80 Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:27:28.267924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:27:28.269724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:27:28.269724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:28.269724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: ad0bef00a05c4029a009992a7f96fa80 Sep 06 16:27:28.269724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:28.269724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeTestJSON-1420528339-project Sep 06 16:27:28.269724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:27:28.269724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:27:28.269724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: e225aec64aee47449542aecbec0ae561 Sep 06 16:27:28.269724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeTestJSON-1420528339-project Sep 06 16:27:28.269724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:27:28.269724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:28.269724 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'a39987c5-d718-40b4-804f-328144e58e8b'} Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:28.270830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. Sep 06 16:27:28.272320 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:28.273868 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e0e72097-ea6d-41af-af61-6109eadbcdcc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Returning 404 to user: Instance a39987c5-d718-40b4-804f-328144e58e8b could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:28.273868 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e0e72097-ea6d-41af-af61-6109eadbcdcc tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b" status: 404 len: 111 microversion: 2.1 time: 0.030409 Sep 06 16:27:28.273868 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 600/1176] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:28 2022] GET /compute/v2.1/servers/a39987c5-d718-40b4-804f-328144e58e8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:29.200705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f2c6af02-3731-42e6-9829-08b5f1ad7663 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:29.201280 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f2c6af02-3731-42e6-9829-08b5f1ad7663 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:29.207794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f2c6af02-3731-42e6-9829-08b5f1ad7663 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.208393 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f2c6af02-3731-42e6-9829-08b5f1ad7663 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.208699 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f2c6af02-3731-42e6-9829-08b5f1ad7663 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.209392 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f2c6af02-3731-42e6-9829-08b5f1ad7663 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.209844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f2c6af02-3731-42e6-9829-08b5f1ad7663 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.210249 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f2c6af02-3731-42e6-9829-08b5f1ad7663 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.356101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f2c6af02-3731-42e6-9829-08b5f1ad7663 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:29.366058 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f2c6af02-3731-42e6-9829-08b5f1ad7663 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.169393 Sep 06 16:27:29.366619 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 577/1177] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:29 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:29.414700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c5838e48-13ad-4139-90b7-0362026cd9c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:29.415216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c5838e48-13ad-4139-90b7-0362026cd9c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:29.417674 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:29.426051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5838e48-13ad-4139-90b7-0362026cd9c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.426548 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5838e48-13ad-4139-90b7-0362026cd9c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.427003 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5838e48-13ad-4139-90b7-0362026cd9c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.427847 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5838e48-13ad-4139-90b7-0362026cd9c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.428324 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5838e48-13ad-4139-90b7-0362026cd9c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.428734 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c5838e48-13ad-4139-90b7-0362026cd9c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.431897 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:29.445564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-c5838e48-13ad-4139-90b7-0362026cd9c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] HTTP exception thrown: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c5838e48-13ad-4139-90b7-0362026cd9c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Request method failure captured: Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: DELETE /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 HTTP/1.1 Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3I7XZAP2rEccRH17orHIdnfGI8mYnSWwhrkcF5L1jIXCtcR_IaNpMNh5npnj8_7Z-b3weCNmmzz3eWc0RpjJ9AUHU9C3oeZy3sGVHsmGEXrDIuh6njoiHyk2a0tU4QTXOebrg73HxMMtpON7bgVW_kGjMHlGIn8ODmFx-sseZ3p_kw Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: ad0bef00a05c4029a009992a7f96fa80 Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:27:29.447236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:27:29.448892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:27:29.448892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:29.448892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: ad0bef00a05c4029a009992a7f96fa80 Sep 06 16:27:29.448892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:29.448892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeTestJSON-1420528339-project Sep 06 16:27:29.448892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:27:29.448892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:27:29.448892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: e225aec64aee47449542aecbec0ae561 Sep 06 16:27:29.448892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeTestJSON-1420528339-project Sep 06 16:27:29.448892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:27:29.448892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:27:29.448892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'dbc140df-902e-4875-822f-53831e91b1c3'} Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:29.449992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:27:29.452360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.454616 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c5838e48-13ad-4139-90b7-0362026cd9c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Returning 404 to user: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:29.454616 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c5838e48-13ad-4139-90b7-0362026cd9c5 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 404 len: 111 microversion: 2.1 time: 0.037835 Sep 06 16:27:29.454616 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 601/1178] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:27:29 2022] DELETE /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:29.459085 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-611f9af4-611e-4123-bd11-197077828ec1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:29.459698 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-611f9af4-611e-4123-bd11-197077828ec1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] [instance: dbc140df-902e-4875-822f-53831e91b1c3] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:29.465847 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-611f9af4-611e-4123-bd11-197077828ec1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.466329 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-611f9af4-611e-4123-bd11-197077828ec1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.466762 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-611f9af4-611e-4123-bd11-197077828ec1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.467455 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-611f9af4-611e-4123-bd11-197077828ec1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.467899 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-611f9af4-611e-4123-bd11-197077828ec1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.468321 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-611f9af4-611e-4123-bd11-197077828ec1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.483970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-611f9af4-611e-4123-bd11-197077828ec1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] HTTP exception thrown: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-611f9af4-611e-4123-bd11-197077828ec1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Request method failure captured: Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 HTTP/1.1 Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3I7XZAP2rEccRH17orHIdnfGI8mYnSWwhrkcF5L1jIXCtcR_IaNpMNh5npnj8_7Z-b3weCNmmzz3eWc0RpjJ9AUHU9C3oeZy3sGVHsmGEXrDIuh6njoiHyk2a0tU4QTXOebrg73HxMMtpON7bgVW_kGjMHlGIn8ODmFx-sseZ3p_kw Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: ad0bef00a05c4029a009992a7f96fa80 Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:27:29.485826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:27:29.487596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0bef00a05c4029a009992a7f96fa80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:27:29.487596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:29.487596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: ad0bef00a05c4029a009992a7f96fa80 Sep 06 16:27:29.487596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1420528339 Sep 06 16:27:29.487596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-AttachVolumeTestJSON-1420528339-project Sep 06 16:27:29.487596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:27:29.487596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:27:29.487596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: e225aec64aee47449542aecbec0ae561 Sep 06 16:27:29.487596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-AttachVolumeTestJSON-1420528339-project Sep 06 16:27:29.487596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:27:29.487596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:27:29.487596 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'dbc140df-902e-4875-822f-53831e91b1c3'} Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:29.488603 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. Sep 06 16:27:29.490131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.491650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-611f9af4-611e-4123-bd11-197077828ec1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] Returning 404 to user: Instance dbc140df-902e-4875-822f-53831e91b1c3 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:29.491650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-611f9af4-611e-4123-bd11-197077828ec1 tempest-AttachVolumeTestJSON-1420528339 tempest-AttachVolumeTestJSON-1420528339-project] 10.222.0.43 "GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3" status: 404 len: 111 microversion: 2.1 time: 0.032029 Sep 06 16:27:29.491650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 578/1179] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:29 2022] GET /compute/v2.1/servers/dbc140df-902e-4875-822f-53831e91b1c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:30.390313 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-8bbbdf3a-d92d-4153-b544-f81ecaa94687 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:30.390827 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-8bbbdf3a-d92d-4153-b544-f81ecaa94687 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:30.398273 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8bbbdf3a-d92d-4153-b544-f81ecaa94687 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:30.398750 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8bbbdf3a-d92d-4153-b544-f81ecaa94687 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:30.399181 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8bbbdf3a-d92d-4153-b544-f81ecaa94687 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:30.399870 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8bbbdf3a-d92d-4153-b544-f81ecaa94687 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:30.400317 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8bbbdf3a-d92d-4153-b544-f81ecaa94687 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:30.400731 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-8bbbdf3a-d92d-4153-b544-f81ecaa94687 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:30.543326 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-8bbbdf3a-d92d-4153-b544-f81ecaa94687 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:30.553178 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-8bbbdf3a-d92d-4153-b544-f81ecaa94687 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.167218 Sep 06 16:27:30.554000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 602/1180] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:30 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:31.579035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-88e4d732-7884-4c36-89f1-156c5ebcc9c4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:31.579733 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-88e4d732-7884-4c36-89f1-156c5ebcc9c4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:31.587341 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-88e4d732-7884-4c36-89f1-156c5ebcc9c4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:31.588146 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-88e4d732-7884-4c36-89f1-156c5ebcc9c4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:31.588788 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-88e4d732-7884-4c36-89f1-156c5ebcc9c4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:31.589472 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-88e4d732-7884-4c36-89f1-156c5ebcc9c4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:31.590101 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-88e4d732-7884-4c36-89f1-156c5ebcc9c4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:31.590552 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-88e4d732-7884-4c36-89f1-156c5ebcc9c4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:31.824485 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-88e4d732-7884-4c36-89f1-156c5ebcc9c4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:31.832658 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-88e4d732-7884-4c36-89f1-156c5ebcc9c4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.259419 Sep 06 16:27:31.833259 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 579/1181] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:31 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:32.856050 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ce565dbe-4a99-4248-854b-23038b9f2adf tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:32.856792 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ce565dbe-4a99-4248-854b-23038b9f2adf tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:32.863363 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce565dbe-4a99-4248-854b-23038b9f2adf tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:32.863845 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce565dbe-4a99-4248-854b-23038b9f2adf tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:32.864268 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce565dbe-4a99-4248-854b-23038b9f2adf tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:32.864977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce565dbe-4a99-4248-854b-23038b9f2adf tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:32.865453 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce565dbe-4a99-4248-854b-23038b9f2adf tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:32.865813 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce565dbe-4a99-4248-854b-23038b9f2adf tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:33.013491 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ce565dbe-4a99-4248-854b-23038b9f2adf tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:33.021668 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ce565dbe-4a99-4248-854b-23038b9f2adf tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.169355 Sep 06 16:27:33.022278 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 603/1182] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:32 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:34.047989 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d9c619de-9831-4e96-8389-89e40feb486d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:34.048806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d9c619de-9831-4e96-8389-89e40feb486d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:34.056183 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d9c619de-9831-4e96-8389-89e40feb486d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:34.056685 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d9c619de-9831-4e96-8389-89e40feb486d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:34.057136 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d9c619de-9831-4e96-8389-89e40feb486d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:34.057857 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d9c619de-9831-4e96-8389-89e40feb486d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:34.058311 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d9c619de-9831-4e96-8389-89e40feb486d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:34.058769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d9c619de-9831-4e96-8389-89e40feb486d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:34.210660 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d9c619de-9831-4e96-8389-89e40feb486d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:34.225417 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d9c619de-9831-4e96-8389-89e40feb486d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.183186 Sep 06 16:27:34.226002 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 580/1183] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:34 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:35.253743 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-cf8d69fc-31cd-49ae-b29a-afe3ea974d6d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:35.254490 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-cf8d69fc-31cd-49ae-b29a-afe3ea974d6d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:35.263893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cf8d69fc-31cd-49ae-b29a-afe3ea974d6d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:35.264805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cf8d69fc-31cd-49ae-b29a-afe3ea974d6d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:35.265547 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cf8d69fc-31cd-49ae-b29a-afe3ea974d6d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:35.266438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cf8d69fc-31cd-49ae-b29a-afe3ea974d6d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:35.266893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cf8d69fc-31cd-49ae-b29a-afe3ea974d6d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:35.267318 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cf8d69fc-31cd-49ae-b29a-afe3ea974d6d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:35.475962 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cf8d69fc-31cd-49ae-b29a-afe3ea974d6d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:35.484146 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-cf8d69fc-31cd-49ae-b29a-afe3ea974d6d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.238372 Sep 06 16:27:35.492858 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 604/1184] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:35 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:36.509685 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1fe07f48-d64a-4b47-94dd-fddd88a34d98 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:36.510383 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1fe07f48-d64a-4b47-94dd-fddd88a34d98 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:36.517553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fe07f48-d64a-4b47-94dd-fddd88a34d98 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:36.518352 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fe07f48-d64a-4b47-94dd-fddd88a34d98 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:36.518956 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fe07f48-d64a-4b47-94dd-fddd88a34d98 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:36.519857 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fe07f48-d64a-4b47-94dd-fddd88a34d98 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:36.520667 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fe07f48-d64a-4b47-94dd-fddd88a34d98 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:36.521694 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1fe07f48-d64a-4b47-94dd-fddd88a34d98 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:36.718924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1fe07f48-d64a-4b47-94dd-fddd88a34d98 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:36.731529 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1fe07f48-d64a-4b47-94dd-fddd88a34d98 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.226068 Sep 06 16:27:36.732411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 581/1185] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:36 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:36.918368 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d13d08e3-d086-4e40-97fd-0e4b80e81984 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:36.922627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d13d08e3-d086-4e40-97fd-0e4b80e81984 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:36.932155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d13d08e3-d086-4e40-97fd-0e4b80e81984 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:36.932962 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d13d08e3-d086-4e40-97fd-0e4b80e81984 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:36.934169 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d13d08e3-d086-4e40-97fd-0e4b80e81984 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:36.940375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d13d08e3-d086-4e40-97fd-0e4b80e81984 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:36.941155 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d13d08e3-d086-4e40-97fd-0e4b80e81984 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:36.941797 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d13d08e3-d086-4e40-97fd-0e4b80e81984 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:36.983834 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d13d08e3-d086-4e40-97fd-0e4b80e81984 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.072611 Sep 06 16:27:37.003644 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 605/1186] 10.222.0.43 () {60 vars in 1343 bytes} [Tue Sep 6 16:27:36 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:37.072557 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-487c4d60-1eda-4229-a47a-5b9e19c82a8c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:37.073293 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-487c4d60-1eda-4229-a47a-5b9e19c82a8c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:37.079770 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-487c4d60-1eda-4229-a47a-5b9e19c82a8c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:37.080522 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-487c4d60-1eda-4229-a47a-5b9e19c82a8c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:37.081219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-487c4d60-1eda-4229-a47a-5b9e19c82a8c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:37.082097 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-487c4d60-1eda-4229-a47a-5b9e19c82a8c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:37.082757 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-487c4d60-1eda-4229-a47a-5b9e19c82a8c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:37.083334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-487c4d60-1eda-4229-a47a-5b9e19c82a8c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:37.114272 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-487c4d60-1eda-4229-a47a-5b9e19c82a8c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Going to try to terminate instance {{(pid=120669) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:27:37.218543 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-487c4d60-1eda-4229-a47a-5b9e19c82a8c tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 204 len: 0 microversion: 2.20 time: 0.149868 Sep 06 16:27:37.219988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 582/1187] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Sep 6 16:27:37 2022] DELETE /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 06 16:27:37.228632 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-35827527-6c8d-4f98-a9e4-278bdd783c2f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:37.229360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-35827527-6c8d-4f98-a9e4-278bdd783c2f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:37.240892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35827527-6c8d-4f98-a9e4-278bdd783c2f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:37.242374 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35827527-6c8d-4f98-a9e4-278bdd783c2f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:37.251138 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35827527-6c8d-4f98-a9e4-278bdd783c2f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:37.252192 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35827527-6c8d-4f98-a9e4-278bdd783c2f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:37.255968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35827527-6c8d-4f98-a9e4-278bdd783c2f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:37.255968 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35827527-6c8d-4f98-a9e4-278bdd783c2f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:37.521384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-35827527-6c8d-4f98-a9e4-278bdd783c2f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:37.534083 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-35827527-6c8d-4f98-a9e4-278bdd783c2f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:37.535679 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-35827527-6c8d-4f98-a9e4-278bdd783c2f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:37.538021 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-35827527-6c8d-4f98-a9e4-278bdd783c2f tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.313370 Sep 06 16:27:37.538589 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 606/1188] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:37 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:37.758050 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7123ee43-05fe-4539-b954-35b4483492af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:37.760499 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7123ee43-05fe-4539-b954-35b4483492af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:37.781369 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7123ee43-05fe-4539-b954-35b4483492af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:37.781958 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7123ee43-05fe-4539-b954-35b4483492af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:37.782507 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7123ee43-05fe-4539-b954-35b4483492af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:37.790471 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7123ee43-05fe-4539-b954-35b4483492af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:37.790471 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7123ee43-05fe-4539-b954-35b4483492af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:37.790471 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7123ee43-05fe-4539-b954-35b4483492af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:37.941074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7123ee43-05fe-4539-b954-35b4483492af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:37.950261 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7123ee43-05fe-4539-b954-35b4483492af tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.198177 Sep 06 16:27:37.951160 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 583/1189] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:37 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:38.563819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c2097bb1-9baf-4596-b5e7-388fdf318ed2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:38.564648 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c2097bb1-9baf-4596-b5e7-388fdf318ed2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:38.573376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c2097bb1-9baf-4596-b5e7-388fdf318ed2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:38.574573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c2097bb1-9baf-4596-b5e7-388fdf318ed2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:38.575554 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c2097bb1-9baf-4596-b5e7-388fdf318ed2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:38.577024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c2097bb1-9baf-4596-b5e7-388fdf318ed2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:38.578065 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c2097bb1-9baf-4596-b5e7-388fdf318ed2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:38.579520 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c2097bb1-9baf-4596-b5e7-388fdf318ed2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:38.788429 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c2097bb1-9baf-4596-b5e7-388fdf318ed2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:38.801430 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c2097bb1-9baf-4596-b5e7-388fdf318ed2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:38.803346 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-c2097bb1-9baf-4596-b5e7-388fdf318ed2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:38.804799 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c2097bb1-9baf-4596-b5e7-388fdf318ed2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.245107 Sep 06 16:27:38.805524 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 607/1190] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:38 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:38.974496 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-83e2c5c2-c3c2-4300-a71b-d7d9ec6b7d0f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:38.975177 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-83e2c5c2-c3c2-4300-a71b-d7d9ec6b7d0f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:38.984071 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83e2c5c2-c3c2-4300-a71b-d7d9ec6b7d0f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:38.984588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83e2c5c2-c3c2-4300-a71b-d7d9ec6b7d0f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:38.985119 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83e2c5c2-c3c2-4300-a71b-d7d9ec6b7d0f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:38.985824 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83e2c5c2-c3c2-4300-a71b-d7d9ec6b7d0f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:38.986280 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83e2c5c2-c3c2-4300-a71b-d7d9ec6b7d0f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:38.986698 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-83e2c5c2-c3c2-4300-a71b-d7d9ec6b7d0f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:39.045085 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4d50666b-5ab0-4af3-9e87-b6c3d2e302a3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: .version_select at 0x7f83e95f41f0>, body: {"keypair": {"name": "tempest-keypair-1583234393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCeNEbnZ9h3nRkaiWT+eEIkUuP3PeMZZaFEhkqoNuFU6Zi//zaWI5T2TAKbJ/loYp8+JSRAduzmdhYGJSNbSglYkKAn+U7lWeVA3KQ27h0svcxGSmJc0D+2Wm25r8vHLg=="}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:39.067026 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-4d50666b-5ab0-4af3-9e87-b6c3d2e302a3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for project 5c722f58536f492aa4eb96085452def4. Resources: {'key_pairs'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:27:39.071376 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-4d50666b-5ab0-4af3-9e87-b6c3d2e302a3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for user 523faa1ac64e4044b9fb651ec28249d9 and project 5c722f58536f492aa4eb96085452def4. Resources: {'key_pairs'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:27:39.098388 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4d50666b-5ab0-4af3-9e87-b6c3d2e302a3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.187914 Sep 06 16:27:39.098979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 584/1191] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 6 16:27:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:39.126730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-83e2c5c2-c3c2-4300-a71b-d7d9ec6b7d0f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:39.136310 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-83e2c5c2-c3c2-4300-a71b-d7d9ec6b7d0f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.165929 Sep 06 16:27:39.137161 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 608/1192] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:38 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:39.831924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-47c792fa-1fe3-4134-8fb0-12092f9fe953 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:39.832186 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-47c792fa-1fe3-4134-8fb0-12092f9fe953 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:39.839717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47c792fa-1fe3-4134-8fb0-12092f9fe953 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:39.840195 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47c792fa-1fe3-4134-8fb0-12092f9fe953 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:39.840622 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47c792fa-1fe3-4134-8fb0-12092f9fe953 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:39.841728 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47c792fa-1fe3-4134-8fb0-12092f9fe953 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:39.842434 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47c792fa-1fe3-4134-8fb0-12092f9fe953 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:39.843085 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-47c792fa-1fe3-4134-8fb0-12092f9fe953 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:40.159802 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-65bdaf50-1985-4f68-85d9-ec21e7630f37 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:40.160454 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-65bdaf50-1985-4f68-85d9-ec21e7630f37 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:40.176118 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-65bdaf50-1985-4f68-85d9-ec21e7630f37 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:40.176606 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-65bdaf50-1985-4f68-85d9-ec21e7630f37 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:40.177064 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-65bdaf50-1985-4f68-85d9-ec21e7630f37 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:40.177770 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-65bdaf50-1985-4f68-85d9-ec21e7630f37 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:40.178219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-65bdaf50-1985-4f68-85d9-ec21e7630f37 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:40.178636 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-65bdaf50-1985-4f68-85d9-ec21e7630f37 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:40.333727 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-47c792fa-1fe3-4134-8fb0-12092f9fe953 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:40.359756 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-47c792fa-1fe3-4134-8fb0-12092f9fe953 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:40.361235 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-47c792fa-1fe3-4134-8fb0-12092f9fe953 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:40.362486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-47c792fa-1fe3-4134-8fb0-12092f9fe953 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1723 microversion: 2.20 time: 0.535869 Sep 06 16:27:40.393321 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 585/1193] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:39 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1723 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:40.535710 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-65bdaf50-1985-4f68-85d9-ec21e7630f37 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:40.555060 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-65bdaf50-1985-4f68-85d9-ec21e7630f37 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1569 microversion: 2.1 time: 0.399293 Sep 06 16:27:40.568988 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 609/1194] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:40 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1569 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:40.581678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d49d6619-f19c-47e9-9b81-70115b4a464a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:40.582384 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d49d6619-f19c-47e9-9b81-70115b4a464a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:40.605127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d49d6619-f19c-47e9-9b81-70115b4a464a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:40.605127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d49d6619-f19c-47e9-9b81-70115b4a464a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:40.605127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d49d6619-f19c-47e9-9b81-70115b4a464a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:40.605127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d49d6619-f19c-47e9-9b81-70115b4a464a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:40.605499 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d49d6619-f19c-47e9-9b81-70115b4a464a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:40.605499 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d49d6619-f19c-47e9-9b81-70115b4a464a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:40.645873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d49d6619-f19c-47e9-9b81-70115b4a464a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120669) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 16:27:40.685680 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1707138789", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4084decc-71da-4dac-8299-c3181b61526b"}], "security_groups": [{"name": "tempest-securitygroup--1719705627"}], "key_name": "tempest-keypair-1583234393", "user_data": "}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:40.765768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d49d6619-f19c-47e9-9b81-70115b4a464a tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "POST /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396/action" status: 202 len: 0 microversion: 2.1 time: 0.188536 Sep 06 16:27:40.770374 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 586/1195] 10.222.0.43 () {60 vars in 1278 bytes} [Tue Sep 6 16:27:40 2022] POST /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:27:40.789056 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5e2b3b34-3bef-468f-81cd-9f7c5b210200 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:40.789950 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5e2b3b34-3bef-468f-81cd-9f7c5b210200 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:40.797499 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5e2b3b34-3bef-468f-81cd-9f7c5b210200 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:40.797657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5e2b3b34-3bef-468f-81cd-9f7c5b210200 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:40.798187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5e2b3b34-3bef-468f-81cd-9f7c5b210200 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:40.799103 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5e2b3b34-3bef-468f-81cd-9f7c5b210200 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:40.799778 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5e2b3b34-3bef-468f-81cd-9f7c5b210200 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:40.800705 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5e2b3b34-3bef-468f-81cd-9f7c5b210200 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:40.862409 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.network.neutron [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] validate_networks() for [('4084decc-71da-4dac-8299-c3181b61526b', None, None, None, None, None)] {{(pid=120668) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:27:41.091023 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5e2b3b34-3bef-468f-81cd-9f7c5b210200 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:41.107706 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5e2b3b34-3bef-468f-81cd-9f7c5b210200 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1517 microversion: 2.1 time: 0.334108 Sep 06 16:27:41.109425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 587/1196] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:40 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1517 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:41.392986 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4f8ae2b5-afcb-48be-9d7d-d66b4c871400 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:41.393505 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4f8ae2b5-afcb-48be-9d7d-d66b4c871400 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:41.401332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f8ae2b5-afcb-48be-9d7d-d66b4c871400 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:41.401810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f8ae2b5-afcb-48be-9d7d-d66b4c871400 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:41.402250 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f8ae2b5-afcb-48be-9d7d-d66b4c871400 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:41.402940 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f8ae2b5-afcb-48be-9d7d-d66b4c871400 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:41.403386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f8ae2b5-afcb-48be-9d7d-d66b4c871400 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:41.403802 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f8ae2b5-afcb-48be-9d7d-d66b4c871400 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:41.513581 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4f8ae2b5-afcb-48be-9d7d-d66b4c871400 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:41.515389 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Flavor limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:27:41.515984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Image limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:27:41.516453 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Flavor pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:27:41.516888 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Image pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:27:41.517291 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:27:41.523883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4f8ae2b5-afcb-48be-9d7d-d66b4c871400 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:41.526035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4f8ae2b5-afcb-48be-9d7d-d66b4c871400 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3a65f26ab214feab60c7b6380539076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b93a6978c404ca4aa497919103b5283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:41.526657 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:41.527134 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:41.527563 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:41.527758 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4f8ae2b5-afcb-48be-9d7d-d66b4c871400 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 200 len: 1655 microversion: 2.20 time: 0.139859 Sep 06 16:27:41.528282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:41.539199 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 588/1197] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:41 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 1655 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:41.539846 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:41.539846 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:41.558366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for project 5c722f58536f492aa4eb96085452def4. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:27:41.562885 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for user 523faa1ac64e4044b9fb651ec28249d9 and project 5c722f58536f492aa4eb96085452def4. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:27:41.575256 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Going to run 1 instances... {{(pid=120668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:27:41.578141 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:27:41.654763 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-30886c6a-a0d5-4cb9-ad9c-82e2016fea86 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.992565 Sep 06 16:27:41.656094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 610/1198] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:27:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:27:41.664724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-617456d4-0493-4e4f-b0a0-6044c76ca2cc req-be2e34d6-dd4e-4713-9f98-75bfb38d69c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5393a1be-4392-48fb-b317-79525e0639b6", "name": "network-vif-deleted", "tag": "871e4881-cbaf-4c42-8c18-28566def207e"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:41.667861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9f253053-ce82-4415-afe2-e15aacb74004 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:41.669441 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9f253053-ce82-4415-afe2-e15aacb74004 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:41.698928 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-617456d4-0493-4e4f-b0a0-6044c76ca2cc req-be2e34d6-dd4e-4713-9f98-75bfb38d69c7 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:41.699814 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-617456d4-0493-4e4f-b0a0-6044c76ca2cc req-be2e34d6-dd4e-4713-9f98-75bfb38d69c7 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:41.701390 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-617456d4-0493-4e4f-b0a0-6044c76ca2cc req-be2e34d6-dd4e-4713-9f98-75bfb38d69c7 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:41.731082 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-617456d4-0493-4e4f-b0a0-6044c76ca2cc req-be2e34d6-dd4e-4713-9f98-75bfb38d69c7 service nova] Creating event network-vif-deleted:871e4881-cbaf-4c42-8c18-28566def207e for instance 5393a1be-4392-48fb-b317-79525e0639b6 on hv-cinder-85221 Sep 06 16:27:41.743109 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-617456d4-0493-4e4f-b0a0-6044c76ca2cc req-be2e34d6-dd4e-4713-9f98-75bfb38d69c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082456 Sep 06 16:27:41.751775 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 589/1199] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:41.811367 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9f253053-ce82-4415-afe2-e15aacb74004 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:41.840925 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9f253053-ce82-4415-afe2-e15aacb74004 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1242 microversion: 2.1 time: 0.177610 Sep 06 16:27:41.842123 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 611/1200] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:41 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1242 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:42.134105 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b20d7a53-1985-438a-8870-38cdd481cc4e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:42.135278 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b20d7a53-1985-438a-8870-38cdd481cc4e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:42.156206 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b20d7a53-1985-438a-8870-38cdd481cc4e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:42.156597 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b20d7a53-1985-438a-8870-38cdd481cc4e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:42.157082 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b20d7a53-1985-438a-8870-38cdd481cc4e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:42.157812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b20d7a53-1985-438a-8870-38cdd481cc4e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:42.158250 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b20d7a53-1985-438a-8870-38cdd481cc4e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:42.158708 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b20d7a53-1985-438a-8870-38cdd481cc4e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:42.493757 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b20d7a53-1985-438a-8870-38cdd481cc4e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:42.508743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b20d7a53-1985-438a-8870-38cdd481cc4e tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1517 microversion: 2.1 time: 0.379985 Sep 06 16:27:42.513198 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 590/1201] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:42 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1517 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:42.556942 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4bd1aac9-4115-4386-a39e-b12b1705fbe4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:42.557588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4bd1aac9-4115-4386-a39e-b12b1705fbe4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:42.573682 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4bd1aac9-4115-4386-a39e-b12b1705fbe4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:42.574201 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4bd1aac9-4115-4386-a39e-b12b1705fbe4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:42.577451 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4bd1aac9-4115-4386-a39e-b12b1705fbe4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:42.580071 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4bd1aac9-4115-4386-a39e-b12b1705fbe4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:42.581638 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4bd1aac9-4115-4386-a39e-b12b1705fbe4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:42.582133 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4bd1aac9-4115-4386-a39e-b12b1705fbe4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:42.607892 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-4bd1aac9-4115-4386-a39e-b12b1705fbe4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] HTTP exception thrown: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4bd1aac9-4115-4386-a39e-b12b1705fbe4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Request method failure captured: Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 HTTP/1.1 Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3I9lyVSeED3DDoPWBRB7NaLIrHgPsEvdQxaRV43JQRFLPSldfzp4ALAKeTQt8A6df3mhMVda_KWDA6NAn_Mgu-35PX3-Zh3vs8qDbdcVLHIWaruPsYMMNtp_gnsKzbjvFwvSY60mVr5GAQaNo70W-h3TO1rK6wyaOOhuFcMIJYWG4M Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 8b93a6978c404ca4aa497919103b5283 Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:27:42.609946 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:27:42.611860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b93a6978c404ca4aa497919103b5283"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:27:42.611860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:42.611860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 8b93a6978c404ca4aa497919103b5283 Sep 06 16:27:42.611860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:42.611860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeShelveTestJSON-902753663-project Sep 06 16:27:42.611860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:27:42.611860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:27:42.611860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: c3a65f26ab214feab60c7b6380539076 Sep 06 16:27:42.611860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902753663-project Sep 06 16:27:42.611860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:27:42.611860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:42.611860 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': '5393a1be-4392-48fb-b317-79525e0639b6'} Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:42.612861 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:42.614485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:42.617787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4bd1aac9-4115-4386-a39e-b12b1705fbe4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Returning 404 to user: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:42.619540 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4bd1aac9-4115-4386-a39e-b12b1705fbe4 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 404 len: 111 microversion: 2.20 time: 0.068775 Sep 06 16:27:42.620665 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 612/1202] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:42 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:27:42.631064 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a1ea1b29-88be-4d37-8fb2-e086c2e88c40 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '.version_select at 0x7f83eccde040>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:42.657927 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a1ea1b29-88be-4d37-8fb2-e086c2e88c40 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044582468" status: 204 len: 0 microversion: 2.20 time: 0.032048 Sep 06 16:27:42.659752 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 591/1203] 10.222.0.43 () {60 vars in 1262 bytes} [Tue Sep 6 16:27:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044582468 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 16:27:42.767691 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-b52bb041-378a-4d05-815a-c3786400b9a4 req-7059ef28-1a5b-40f6-ab89-e1d362949693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993ac4a3-a4e1-43cb-b6da-af83833f1396", "name": "network-vif-unplugged", "status": "completed", "tag": "b8387b10-ca79-44d9-bb60-26753cfeeac9"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:42.778234 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-b52bb041-378a-4d05-815a-c3786400b9a4 req-7059ef28-1a5b-40f6-ab89-e1d362949693 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:42.779228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-b52bb041-378a-4d05-815a-c3786400b9a4 req-7059ef28-1a5b-40f6-ab89-e1d362949693 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:42.779830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-b52bb041-378a-4d05-815a-c3786400b9a4 req-7059ef28-1a5b-40f6-ab89-e1d362949693 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:42.807998 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.compute.server_external_events [req-b52bb041-378a-4d05-815a-c3786400b9a4 req-7059ef28-1a5b-40f6-ab89-e1d362949693 service nova] Unable to find a host for instance 993ac4a3-a4e1-43cb-b6da-af83833f1396. Dropping event network-vif-unplugged {{(pid=120668) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 06 16:27:42.809391 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-b52bb041-378a-4d05-815a-c3786400b9a4 req-7059ef28-1a5b-40f6-ab89-e1d362949693 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.046141 Sep 06 16:27:42.811834 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 613/1204] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 06 16:27:42.864422 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1ee1a6e5-eccb-468e-bd4c-e9292cf4ed7a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:42.865710 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1ee1a6e5-eccb-468e-bd4c-e9292cf4ed7a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:42.874710 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1ee1a6e5-eccb-468e-bd4c-e9292cf4ed7a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:42.875193 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1ee1a6e5-eccb-468e-bd4c-e9292cf4ed7a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:42.875734 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1ee1a6e5-eccb-468e-bd4c-e9292cf4ed7a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:42.876446 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1ee1a6e5-eccb-468e-bd4c-e9292cf4ed7a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:42.877459 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1ee1a6e5-eccb-468e-bd4c-e9292cf4ed7a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:42.877949 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1ee1a6e5-eccb-468e-bd4c-e9292cf4ed7a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:42.979868 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1ee1a6e5-eccb-468e-bd4c-e9292cf4ed7a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:42.994640 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1ee1a6e5-eccb-468e-bd4c-e9292cf4ed7a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1238 microversion: 2.1 time: 0.134564 Sep 06 16:27:42.995918 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 592/1205] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:42 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1238 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:43.534341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-311ee1ad-cb4f-4855-8cca-c246773e852b tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:43.535707 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-311ee1ad-cb4f-4855-8cca-c246773e852b tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:43.542709 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-311ee1ad-cb4f-4855-8cca-c246773e852b tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:43.543655 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-311ee1ad-cb4f-4855-8cca-c246773e852b tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:43.544384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-311ee1ad-cb4f-4855-8cca-c246773e852b tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:43.545500 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-311ee1ad-cb4f-4855-8cca-c246773e852b tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:43.546146 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-311ee1ad-cb4f-4855-8cca-c246773e852b tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:43.546847 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-311ee1ad-cb4f-4855-8cca-c246773e852b tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:43.711379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-311ee1ad-cb4f-4855-8cca-c246773e852b tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:43.722787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-311ee1ad-cb4f-4855-8cca-c246773e852b tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1519 microversion: 2.1 time: 0.192575 Sep 06 16:27:43.725393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 614/1206] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:43 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:44.022440 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d11a45f3-352a-419d-aaf0-a408cf45286b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:44.023073 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d11a45f3-352a-419d-aaf0-a408cf45286b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:44.029826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d11a45f3-352a-419d-aaf0-a408cf45286b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:44.030394 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d11a45f3-352a-419d-aaf0-a408cf45286b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:44.030738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d11a45f3-352a-419d-aaf0-a408cf45286b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:44.031504 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d11a45f3-352a-419d-aaf0-a408cf45286b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:44.032059 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d11a45f3-352a-419d-aaf0-a408cf45286b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:44.032602 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d11a45f3-352a-419d-aaf0-a408cf45286b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:44.050575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:44.115640 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d11a45f3-352a-419d-aaf0-a408cf45286b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:44.123620 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d11a45f3-352a-419d-aaf0-a408cf45286b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1300 microversion: 2.1 time: 0.105483 Sep 06 16:27:44.124294 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 593/1207] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:44 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:44.707092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b4256ebd-779b-4d98-bd83-44e674054e54 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:44.707616 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b4256ebd-779b-4d98-bd83-44e674054e54 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:44.714685 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b4256ebd-779b-4d98-bd83-44e674054e54 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:44.715347 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b4256ebd-779b-4d98-bd83-44e674054e54 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:44.715585 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b4256ebd-779b-4d98-bd83-44e674054e54 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:44.716284 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b4256ebd-779b-4d98-bd83-44e674054e54 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:44.716734 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b4256ebd-779b-4d98-bd83-44e674054e54 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:44.717177 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b4256ebd-779b-4d98-bd83-44e674054e54 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:44.731602 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-b4256ebd-779b-4d98-bd83-44e674054e54 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] HTTP exception thrown: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b4256ebd-779b-4d98-bd83-44e674054e54 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Request method failure captured: Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: DELETE /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 HTTP/1.1 Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3I9lyVSeED3DDoPWBRB7NaLIrHgPsEvdQxaRV43JQRFLPSldfzp4ALAKeTQt8A6df3mhMVda_KWDA6NAn_Mgu-35PX3-Zh3vs8qDbdcVLHIWaruPsYMMNtp_gnsKzbjvFwvSY60mVr5GAQaNo70W-h3TO1rK6wyaOOhuFcMIJYWG4M Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 8b93a6978c404ca4aa497919103b5283 Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:27:44.733200 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:27:44.734726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b93a6978c404ca4aa497919103b5283"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:27:44.734726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:44.734726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 8b93a6978c404ca4aa497919103b5283 Sep 06 16:27:44.734726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:44.734726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeShelveTestJSON-902753663-project Sep 06 16:27:44.734726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:27:44.734726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:27:44.734726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: c3a65f26ab214feab60c7b6380539076 Sep 06 16:27:44.734726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902753663-project Sep 06 16:27:44.734726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:27:44.734726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:44.734726 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': '5393a1be-4392-48fb-b317-79525e0639b6'} Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:44.735583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:44.737018 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:44.740627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b4256ebd-779b-4d98-bd83-44e674054e54 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Returning 404 to user: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:44.740627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b4256ebd-779b-4d98-bd83-44e674054e54 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 404 len: 111 microversion: 2.20 time: 0.031786 Sep 06 16:27:44.740627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 615/1208] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Sep 6 16:27:44 2022] DELETE /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:27:44.744048 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0902882c-fc98-44ed-9faa-54ff8e6ea2e2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:44.744607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0902882c-fc98-44ed-9faa-54ff8e6ea2e2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: 5393a1be-4392-48fb-b317-79525e0639b6] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:44.755920 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ebe23e10-e3cd-4bc5-8897-0b585cf94544 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:44.756529 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ebe23e10-e3cd-4bc5-8897-0b585cf94544 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:44.759946 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0902882c-fc98-44ed-9faa-54ff8e6ea2e2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:44.760446 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0902882c-fc98-44ed-9faa-54ff8e6ea2e2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:44.760921 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0902882c-fc98-44ed-9faa-54ff8e6ea2e2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:44.761637 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0902882c-fc98-44ed-9faa-54ff8e6ea2e2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:44.762089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0902882c-fc98-44ed-9faa-54ff8e6ea2e2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:44.762513 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0902882c-fc98-44ed-9faa-54ff8e6ea2e2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:44.776297 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ebe23e10-e3cd-4bc5-8897-0b585cf94544 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:44.777695 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-0902882c-fc98-44ed-9faa-54ff8e6ea2e2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] HTTP exception thrown: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:44.777877 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ebe23e10-e3cd-4bc5-8897-0b585cf94544 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:44.778304 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ebe23e10-e3cd-4bc5-8897-0b585cf94544 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0902882c-fc98-44ed-9faa-54ff8e6ea2e2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Request method failure captured: Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 HTTP/1.1 Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3I9lyVSeED3DDoPWBRB7NaLIrHgPsEvdQxaRV43JQRFLPSldfzp4ALAKeTQt8A6df3mhMVda_KWDA6NAn_Mgu-35PX3-Zh3vs8qDbdcVLHIWaruPsYMMNtp_gnsKzbjvFwvSY60mVr5GAQaNo70W-h3TO1rK6wyaOOhuFcMIJYWG4M Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 8b93a6978c404ca4aa497919103b5283 Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:27:44.779906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:27:44.781650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b93a6978c404ca4aa497919103b5283"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:27:44.781650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:44.781650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 8b93a6978c404ca4aa497919103b5283 Sep 06 16:27:44.781650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:44.781650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-AttachVolumeShelveTestJSON-902753663-project Sep 06 16:27:44.781650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:27:44.781650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:27:44.781650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: c3a65f26ab214feab60c7b6380539076 Sep 06 16:27:44.781650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902753663-project Sep 06 16:27:44.781650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:27:44.781650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:44.781650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': '5393a1be-4392-48fb-b317-79525e0639b6'} Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:44.782646 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. Sep 06 16:27:44.784336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:44.785786 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ebe23e10-e3cd-4bc5-8897-0b585cf94544 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:44.785786 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ebe23e10-e3cd-4bc5-8897-0b585cf94544 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:44.785786 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ebe23e10-e3cd-4bc5-8897-0b585cf94544 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:44.787579 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0902882c-fc98-44ed-9faa-54ff8e6ea2e2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Returning 404 to user: Instance 5393a1be-4392-48fb-b317-79525e0639b6 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:44.789613 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0902882c-fc98-44ed-9faa-54ff8e6ea2e2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6" status: 404 len: 111 microversion: 2.20 time: 0.049937 Sep 06 16:27:44.794378 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 594/1209] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:44 2022] GET /compute/v2.1/servers/5393a1be-4392-48fb-b317-79525e0639b6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:27:44.959506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ebe23e10-e3cd-4bc5-8897-0b585cf94544 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:44.967336 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ebe23e10-e3cd-4bc5-8897-0b585cf94544 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1575 microversion: 2.1 time: 0.218890 Sep 06 16:27:44.967897 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 616/1210] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:44 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:45.147997 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-24d547f7-1b38-4a6b-bf8f-ce38d5ef1cd5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:45.148935 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-24d547f7-1b38-4a6b-bf8f-ce38d5ef1cd5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:45.155623 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24d547f7-1b38-4a6b-bf8f-ce38d5ef1cd5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:45.156109 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24d547f7-1b38-4a6b-bf8f-ce38d5ef1cd5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:45.156534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24d547f7-1b38-4a6b-bf8f-ce38d5ef1cd5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:45.157263 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24d547f7-1b38-4a6b-bf8f-ce38d5ef1cd5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:45.157712 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24d547f7-1b38-4a6b-bf8f-ce38d5ef1cd5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:45.158135 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24d547f7-1b38-4a6b-bf8f-ce38d5ef1cd5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:45.385838 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-24d547f7-1b38-4a6b-bf8f-ce38d5ef1cd5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:45.393846 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-24d547f7-1b38-4a6b-bf8f-ce38d5ef1cd5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1368 microversion: 2.1 time: 0.250875 Sep 06 16:27:45.394425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 595/1211] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:45 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:45.649251 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-a3d2fd57-89ff-4af4-bca6-6db6f486fdfe req-57632127-9db9-4ba6-8a08-c7b823c71726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d7393f-d0b9-480d-bfe7-36439a86c064", "tag": "b3676286-2353-4328-82d5-f123f7bfbd1d"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:45.658759 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a3d2fd57-89ff-4af4-bca6-6db6f486fdfe req-57632127-9db9-4ba6-8a08-c7b823c71726 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:45.659199 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a3d2fd57-89ff-4af4-bca6-6db6f486fdfe req-57632127-9db9-4ba6-8a08-c7b823c71726 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:45.659622 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-a3d2fd57-89ff-4af4-bca6-6db6f486fdfe req-57632127-9db9-4ba6-8a08-c7b823c71726 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:45.670548 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-a3d2fd57-89ff-4af4-bca6-6db6f486fdfe req-57632127-9db9-4ba6-8a08-c7b823c71726 service nova] Creating event network-changed:b3676286-2353-4328-82d5-f123f7bfbd1d for instance e7d7393f-d0b9-480d-bfe7-36439a86c064 on hv-cinder-85221 Sep 06 16:27:45.675886 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-a3d2fd57-89ff-4af4-bca6-6db6f486fdfe req-57632127-9db9-4ba6-8a08-c7b823c71726 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030314 Sep 06 16:27:45.676466 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 617/1212] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:45.956330 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6dc21251-1191-420f-8d81-5fbd3beb02f2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:45.957046 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6dc21251-1191-420f-8d81-5fbd3beb02f2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:45.963346 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6dc21251-1191-420f-8d81-5fbd3beb02f2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:45.963828 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6dc21251-1191-420f-8d81-5fbd3beb02f2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:45.964255 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6dc21251-1191-420f-8d81-5fbd3beb02f2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:45.965011 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6dc21251-1191-420f-8d81-5fbd3beb02f2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:45.965455 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6dc21251-1191-420f-8d81-5fbd3beb02f2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:45.965873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6dc21251-1191-420f-8d81-5fbd3beb02f2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:45.979717 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-6dc21251-1191-420f-8d81-5fbd3beb02f2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] HTTP exception thrown: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6dc21251-1191-420f-8d81-5fbd3beb02f2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Request method failure captured: Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: DELETE /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 HTTP/1.1 Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3I9lyVSeED3DDoPWBRB7NaLIrHgPsEvdQxaRV43JQRFLPSldfzp4ALAKeTQt8A6df3mhMVda_KWDA6NAn_Mgu-35PX3-Zh3vs8qDbdcVLHIWaruPsYMMNtp_gnsKzbjvFwvSY60mVr5GAQaNo70W-h3TO1rK6wyaOOhuFcMIJYWG4M Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 8b93a6978c404ca4aa497919103b5283 Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:27:45.981312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:27:45.983970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b93a6978c404ca4aa497919103b5283"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:27:45.983970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:45.983970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 8b93a6978c404ca4aa497919103b5283 Sep 06 16:27:45.983970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:45.983970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-AttachVolumeShelveTestJSON-902753663-project Sep 06 16:27:45.983970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:27:45.983970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:27:45.983970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: c3a65f26ab214feab60c7b6380539076 Sep 06 16:27:45.983970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902753663-project Sep 06 16:27:45.983970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:27:45.983970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:27:45.983970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2'} Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:45.984995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:27:45.986812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.988414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6dc21251-1191-420f-8d81-5fbd3beb02f2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Returning 404 to user: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:45.988414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6dc21251-1191-420f-8d81-5fbd3beb02f2 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 404 len: 111 microversion: 2.20 time: 0.030541 Sep 06 16:27:45.988414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 596/1213] 10.222.0.43 () {60 vars in 1280 bytes} [Tue Sep 6 16:27:45 2022] DELETE /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:27:45.993528 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-80366f84-4aae-44b2-89c5-7a1fecd751d4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:45.994208 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-80366f84-4aae-44b2-89c5-7a1fecd751d4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:45.994897 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-021cfa2c-4e60-4a90-9a7d-df66fb478258 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:45.995590 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-021cfa2c-4e60-4a90-9a7d-df66fb478258 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] [instance: b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:46.000620 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80366f84-4aae-44b2-89c5-7a1fecd751d4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.001214 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80366f84-4aae-44b2-89c5-7a1fecd751d4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.001702 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80366f84-4aae-44b2-89c5-7a1fecd751d4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.002400 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80366f84-4aae-44b2-89c5-7a1fecd751d4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.002841 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80366f84-4aae-44b2-89c5-7a1fecd751d4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.003446 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-80366f84-4aae-44b2-89c5-7a1fecd751d4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.003908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-021cfa2c-4e60-4a90-9a7d-df66fb478258 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.004602 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-021cfa2c-4e60-4a90-9a7d-df66fb478258 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.005207 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-021cfa2c-4e60-4a90-9a7d-df66fb478258 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.006134 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-021cfa2c-4e60-4a90-9a7d-df66fb478258 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.006356 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-021cfa2c-4e60-4a90-9a7d-df66fb478258 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.007024 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-021cfa2c-4e60-4a90-9a7d-df66fb478258 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.023049 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-021cfa2c-4e60-4a90-9a7d-df66fb478258 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] HTTP exception thrown: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-021cfa2c-4e60-4a90-9a7d-df66fb478258 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Request method failure captured: Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 HTTP/1.1 Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3I9lyVSeED3DDoPWBRB7NaLIrHgPsEvdQxaRV43JQRFLPSldfzp4ALAKeTQt8A6df3mhMVda_KWDA6NAn_Mgu-35PX3-Zh3vs8qDbdcVLHIWaruPsYMMNtp_gnsKzbjvFwvSY60mVr5GAQaNo70W-h3TO1rK6wyaOOhuFcMIJYWG4M Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 8b93a6978c404ca4aa497919103b5283 Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:27:46.024718 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:27:46.026533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b93a6978c404ca4aa497919103b5283"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b93a6978c404ca4aa497919103b5283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:27:46.026533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:46.026533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 8b93a6978c404ca4aa497919103b5283 Sep 06 16:27:46.026533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902753663 Sep 06 16:27:46.026533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeShelveTestJSON-902753663-project Sep 06 16:27:46.026533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:27:46.026533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:27:46.026533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: c3a65f26ab214feab60c7b6380539076 Sep 06 16:27:46.026533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902753663-project Sep 06 16:27:46.026533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:27:46.026533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:27:46.026533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2'} Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:46.027463 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. Sep 06 16:27:46.030206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.033267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-021cfa2c-4e60-4a90-9a7d-df66fb478258 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] Returning 404 to user: Instance b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:46.033267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-021cfa2c-4e60-4a90-9a7d-df66fb478258 tempest-AttachVolumeShelveTestJSON-902753663 tempest-AttachVolumeShelveTestJSON-902753663-project] 10.222.0.43 "GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2" status: 404 len: 111 microversion: 2.20 time: 0.036081 Sep 06 16:27:46.033267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 618/1214] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:45 2022] GET /compute/v2.1/servers/b6df8b0a-5a79-4eb9-a9a7-a3724b2bfeb2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:27:46.352955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-80366f84-4aae-44b2-89c5-7a1fecd751d4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:46.361566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-80366f84-4aae-44b2-89c5-7a1fecd751d4 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1575 microversion: 2.1 time: 0.371561 Sep 06 16:27:46.362103 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 597/1215] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:45 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1575 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:46.417643 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d165f1db-b6ea-4a50-96ba-49832622b7da tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:46.418257 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d165f1db-b6ea-4a50-96ba-49832622b7da tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:46.425536 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d165f1db-b6ea-4a50-96ba-49832622b7da tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.426013 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d165f1db-b6ea-4a50-96ba-49832622b7da tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.426487 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d165f1db-b6ea-4a50-96ba-49832622b7da tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.427180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d165f1db-b6ea-4a50-96ba-49832622b7da tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.427789 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d165f1db-b6ea-4a50-96ba-49832622b7da tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.428210 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d165f1db-b6ea-4a50-96ba-49832622b7da tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.564776 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d165f1db-b6ea-4a50-96ba-49832622b7da tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:46.572779 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d165f1db-b6ea-4a50-96ba-49832622b7da tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1368 microversion: 2.1 time: 0.159408 Sep 06 16:27:46.573354 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 619/1216] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:46 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:47.385828 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-59dcd24a-2fa6-4e13-9982-c2ab51731e60 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:47.386400 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-59dcd24a-2fa6-4e13-9982-c2ab51731e60 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:47.392673 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-59dcd24a-2fa6-4e13-9982-c2ab51731e60 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:47.393472 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-59dcd24a-2fa6-4e13-9982-c2ab51731e60 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:47.393889 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-59dcd24a-2fa6-4e13-9982-c2ab51731e60 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:47.394578 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-59dcd24a-2fa6-4e13-9982-c2ab51731e60 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:47.395019 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-59dcd24a-2fa6-4e13-9982-c2ab51731e60 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:47.395462 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-59dcd24a-2fa6-4e13-9982-c2ab51731e60 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:47.596704 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-d1cf54f3-e3f3-469e-aaab-a63fcf955cd7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:47.597370 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-d1cf54f3-e3f3-469e-aaab-a63fcf955cd7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:47.605312 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1cf54f3-e3f3-469e-aaab-a63fcf955cd7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:47.605823 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1cf54f3-e3f3-469e-aaab-a63fcf955cd7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:47.606222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1cf54f3-e3f3-469e-aaab-a63fcf955cd7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:47.606931 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1cf54f3-e3f3-469e-aaab-a63fcf955cd7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:47.607366 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1cf54f3-e3f3-469e-aaab-a63fcf955cd7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:47.607771 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-d1cf54f3-e3f3-469e-aaab-a63fcf955cd7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:47.693827 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-59dcd24a-2fa6-4e13-9982-c2ab51731e60 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:47.702584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-59dcd24a-2fa6-4e13-9982-c2ab51731e60 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1575 microversion: 2.1 time: 0.320713 Sep 06 16:27:47.716788 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 598/1217] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:47 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1575 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:47.755651 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-d1cf54f3-e3f3-469e-aaab-a63fcf955cd7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:47.763730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-d1cf54f3-e3f3-469e-aaab-a63fcf955cd7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1368 microversion: 2.1 time: 0.171702 Sep 06 16:27:47.764310 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 620/1218] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:47 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:48.732387 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cd99edc8-a9af-4c7b-9e57-020af8e21532 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:48.733056 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cd99edc8-a9af-4c7b-9e57-020af8e21532 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:48.740202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd99edc8-a9af-4c7b-9e57-020af8e21532 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:48.740686 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd99edc8-a9af-4c7b-9e57-020af8e21532 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:48.741142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd99edc8-a9af-4c7b-9e57-020af8e21532 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:48.742025 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd99edc8-a9af-4c7b-9e57-020af8e21532 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:48.742479 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd99edc8-a9af-4c7b-9e57-020af8e21532 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:48.742902 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd99edc8-a9af-4c7b-9e57-020af8e21532 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:48.792234 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e5597e35-eeb7-4845-bb5b-291954ce4639 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:48.792828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e5597e35-eeb7-4845-bb5b-291954ce4639 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:48.811313 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e5597e35-eeb7-4845-bb5b-291954ce4639 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:48.813129 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e5597e35-eeb7-4845-bb5b-291954ce4639 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:48.813605 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e5597e35-eeb7-4845-bb5b-291954ce4639 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:48.814609 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e5597e35-eeb7-4845-bb5b-291954ce4639 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:48.816377 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e5597e35-eeb7-4845-bb5b-291954ce4639 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:48.817252 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e5597e35-eeb7-4845-bb5b-291954ce4639 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:48.908070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cd99edc8-a9af-4c7b-9e57-020af8e21532 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:48.919345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cd99edc8-a9af-4c7b-9e57-020af8e21532 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1575 microversion: 2.1 time: 0.190833 Sep 06 16:27:48.934405 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 599/1219] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:48 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:49.062422 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e5597e35-eeb7-4845-bb5b-291954ce4639 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:49.070966 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e5597e35-eeb7-4845-bb5b-291954ce4639 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1368 microversion: 2.1 time: 0.286556 Sep 06 16:27:49.071544 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 621/1220] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:48 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:49.944738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cd2991e9-0bf8-4d75-8c6d-eeeb2cde85ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:49.945368 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cd2991e9-0bf8-4d75-8c6d-eeeb2cde85ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:49.947253 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=4 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:49.953421 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd2991e9-0bf8-4d75-8c6d-eeeb2cde85ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:49.953893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd2991e9-0bf8-4d75-8c6d-eeeb2cde85ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:49.954321 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd2991e9-0bf8-4d75-8c6d-eeeb2cde85ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:49.955036 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd2991e9-0bf8-4d75-8c6d-eeeb2cde85ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:49.955483 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd2991e9-0bf8-4d75-8c6d-eeeb2cde85ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:49.955900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cd2991e9-0bf8-4d75-8c6d-eeeb2cde85ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:50.094680 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4caa3a94-c731-4860-8842-7381ba68b9c9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:50.095397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4caa3a94-c731-4860-8842-7381ba68b9c9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:50.095579 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cd2991e9-0bf8-4d75-8c6d-eeeb2cde85ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:50.102700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4caa3a94-c731-4860-8842-7381ba68b9c9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:50.103456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4caa3a94-c731-4860-8842-7381ba68b9c9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:50.103993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4caa3a94-c731-4860-8842-7381ba68b9c9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:50.104843 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4caa3a94-c731-4860-8842-7381ba68b9c9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:50.105015 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cd2991e9-0bf8-4d75-8c6d-eeeb2cde85ae tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1575 microversion: 2.1 time: 0.164419 Sep 06 16:27:50.105476 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4caa3a94-c731-4860-8842-7381ba68b9c9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:50.105610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 600/1221] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:49 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:50.106278 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4caa3a94-c731-4860-8842-7381ba68b9c9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:50.351079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4caa3a94-c731-4860-8842-7381ba68b9c9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:50.374711 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4caa3a94-c731-4860-8842-7381ba68b9c9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1368 microversion: 2.1 time: 0.285147 Sep 06 16:27:50.375503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 622/1222] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:50 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:51.129414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-34d78b1a-843e-4724-9c92-61ee6d7869f3 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:51.130220 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-34d78b1a-843e-4724-9c92-61ee6d7869f3 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:51.138031 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-34d78b1a-843e-4724-9c92-61ee6d7869f3 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:51.140519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-34d78b1a-843e-4724-9c92-61ee6d7869f3 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:51.141041 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-34d78b1a-843e-4724-9c92-61ee6d7869f3 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:51.141840 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-34d78b1a-843e-4724-9c92-61ee6d7869f3 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:51.142452 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-34d78b1a-843e-4724-9c92-61ee6d7869f3 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:51.142995 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-34d78b1a-843e-4724-9c92-61ee6d7869f3 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:51.303456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-34d78b1a-843e-4724-9c92-61ee6d7869f3 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:51.315480 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-34d78b1a-843e-4724-9c92-61ee6d7869f3 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1575 microversion: 2.1 time: 0.190364 Sep 06 16:27:51.320934 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 601/1223] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:51 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:51.401331 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-29df93f6-a2e5-477b-89e3-42cdb28c9203 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:51.402044 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-29df93f6-a2e5-477b-89e3-42cdb28c9203 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:51.408681 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29df93f6-a2e5-477b-89e3-42cdb28c9203 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:51.409201 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29df93f6-a2e5-477b-89e3-42cdb28c9203 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:51.410065 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29df93f6-a2e5-477b-89e3-42cdb28c9203 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:51.410680 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29df93f6-a2e5-477b-89e3-42cdb28c9203 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:51.411218 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29df93f6-a2e5-477b-89e3-42cdb28c9203 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:51.411218 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-29df93f6-a2e5-477b-89e3-42cdb28c9203 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:51.429190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=100 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:51.543835 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:51.555595 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-29df93f6-a2e5-477b-89e3-42cdb28c9203 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:51.564827 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-29df93f6-a2e5-477b-89e3-42cdb28c9203 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1368 microversion: 2.1 time: 0.168901 Sep 06 16:27:51.565403 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 623/1224] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:51 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:52.340839 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-61b4688a-20e7-4de0-ba64-e1dfe8ee91b9 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:52.341515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-61b4688a-20e7-4de0-ba64-e1dfe8ee91b9 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:52.348839 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-61b4688a-20e7-4de0-ba64-e1dfe8ee91b9 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:52.349466 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-61b4688a-20e7-4de0-ba64-e1dfe8ee91b9 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:52.349919 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-61b4688a-20e7-4de0-ba64-e1dfe8ee91b9 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:52.350626 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-61b4688a-20e7-4de0-ba64-e1dfe8ee91b9 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:52.351075 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-61b4688a-20e7-4de0-ba64-e1dfe8ee91b9 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:52.351581 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-61b4688a-20e7-4de0-ba64-e1dfe8ee91b9 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:52.516156 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-61b4688a-20e7-4de0-ba64-e1dfe8ee91b9 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:52.525317 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-61b4688a-20e7-4de0-ba64-e1dfe8ee91b9 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1575 microversion: 2.1 time: 0.188970 Sep 06 16:27:52.525886 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 602/1225] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:52 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:52.587653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f84a1184-2ada-406e-a7c1-df3757ec30b3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:52.588267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f84a1184-2ada-406e-a7c1-df3757ec30b3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:52.590365 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=8 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:52.596429 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f84a1184-2ada-406e-a7c1-df3757ec30b3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:52.597234 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f84a1184-2ada-406e-a7c1-df3757ec30b3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:52.597365 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f84a1184-2ada-406e-a7c1-df3757ec30b3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:52.598053 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f84a1184-2ada-406e-a7c1-df3757ec30b3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:52.598498 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f84a1184-2ada-406e-a7c1-df3757ec30b3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:52.598954 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f84a1184-2ada-406e-a7c1-df3757ec30b3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:52.738986 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f84a1184-2ada-406e-a7c1-df3757ec30b3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:52.746872 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f84a1184-2ada-406e-a7c1-df3757ec30b3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1368 microversion: 2.1 time: 0.163282 Sep 06 16:27:52.747438 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 624/1226] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:52 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:53.551422 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fbe3e222-9f7a-449d-bfa3-ec99af6ff0b0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:53.552086 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fbe3e222-9f7a-449d-bfa3-ec99af6ff0b0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:53.558674 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fbe3e222-9f7a-449d-bfa3-ec99af6ff0b0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:53.559137 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fbe3e222-9f7a-449d-bfa3-ec99af6ff0b0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:53.559593 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fbe3e222-9f7a-449d-bfa3-ec99af6ff0b0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:53.560304 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fbe3e222-9f7a-449d-bfa3-ec99af6ff0b0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:53.560742 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fbe3e222-9f7a-449d-bfa3-ec99af6ff0b0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:53.561182 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fbe3e222-9f7a-449d-bfa3-ec99af6ff0b0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:53.736225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fbe3e222-9f7a-449d-bfa3-ec99af6ff0b0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:53.744304 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fbe3e222-9f7a-449d-bfa3-ec99af6ff0b0 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1575 microversion: 2.1 time: 0.197826 Sep 06 16:27:53.744939 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 603/1227] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:53 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1575 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:53.770418 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-04adce7b-3f36-4d81-80e6-89047c961fb7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:53.771216 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-04adce7b-3f36-4d81-80e6-89047c961fb7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:53.777891 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04adce7b-3f36-4d81-80e6-89047c961fb7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:53.778443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04adce7b-3f36-4d81-80e6-89047c961fb7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:53.778940 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04adce7b-3f36-4d81-80e6-89047c961fb7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:53.779696 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04adce7b-3f36-4d81-80e6-89047c961fb7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:53.780235 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04adce7b-3f36-4d81-80e6-89047c961fb7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:53.780714 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-04adce7b-3f36-4d81-80e6-89047c961fb7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:53.916230 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-04adce7b-3f36-4d81-80e6-89047c961fb7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:53.923925 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-04adce7b-3f36-4d81-80e6-89047c961fb7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1368 microversion: 2.1 time: 0.157443 Sep 06 16:27:53.924494 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 625/1228] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:53 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:54.767841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-597be72c-9afe-43db-a3f3-29143b01b5e7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:54.768683 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-597be72c-9afe-43db-a3f3-29143b01b5e7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:54.776329 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-597be72c-9afe-43db-a3f3-29143b01b5e7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:54.777597 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-597be72c-9afe-43db-a3f3-29143b01b5e7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:54.778265 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-597be72c-9afe-43db-a3f3-29143b01b5e7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:54.779166 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-597be72c-9afe-43db-a3f3-29143b01b5e7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:54.780058 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-597be72c-9afe-43db-a3f3-29143b01b5e7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:54.780828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-597be72c-9afe-43db-a3f3-29143b01b5e7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:54.943618 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-597be72c-9afe-43db-a3f3-29143b01b5e7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:54.952631 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-597be72c-9afe-43db-a3f3-29143b01b5e7 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1575 microversion: 2.1 time: 0.188587 Sep 06 16:27:54.953284 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 626/1229] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:54 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:54.957943 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7599e73b-704e-4db9-81f4-a84317c60fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:54.958100 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-5fd1bdeb-d8d3-492f-975f-0a2596fe8c29 req-c3a8bf60-8706-4fb7-89f8-9be5fb6ec026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d7393f-d0b9-480d-bfe7-36439a86c064", "name": "network-vif-plugged", "status": "completed", "tag": "b3676286-2353-4328-82d5-f123f7bfbd1d"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:54.959401 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7599e73b-704e-4db9-81f4-a84317c60fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:54.965646 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7599e73b-704e-4db9-81f4-a84317c60fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:54.966567 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7599e73b-704e-4db9-81f4-a84317c60fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:54.967222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7599e73b-704e-4db9-81f4-a84317c60fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:54.968111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7599e73b-704e-4db9-81f4-a84317c60fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:54.968794 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7599e73b-704e-4db9-81f4-a84317c60fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:54.969403 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7599e73b-704e-4db9-81f4-a84317c60fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:54.977712 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5fd1bdeb-d8d3-492f-975f-0a2596fe8c29 req-c3a8bf60-8706-4fb7-89f8-9be5fb6ec026 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:54.978200 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5fd1bdeb-d8d3-492f-975f-0a2596fe8c29 req-c3a8bf60-8706-4fb7-89f8-9be5fb6ec026 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:54.978635 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-5fd1bdeb-d8d3-492f-975f-0a2596fe8c29 req-c3a8bf60-8706-4fb7-89f8-9be5fb6ec026 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:54.991233 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-5fd1bdeb-d8d3-492f-975f-0a2596fe8c29 req-c3a8bf60-8706-4fb7-89f8-9be5fb6ec026 service nova] Creating event network-vif-plugged:b3676286-2353-4328-82d5-f123f7bfbd1d for instance e7d7393f-d0b9-480d-bfe7-36439a86c064 on hv-cinder-85221 Sep 06 16:27:54.997202 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-5fd1bdeb-d8d3-492f-975f-0a2596fe8c29 req-c3a8bf60-8706-4fb7-89f8-9be5fb6ec026 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278063 Sep 06 16:27:54.998563 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 604/1230] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:55.140348 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7599e73b-704e-4db9-81f4-a84317c60fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:55.150133 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7599e73b-704e-4db9-81f4-a84317c60fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1368 microversion: 2.1 time: 0.195827 Sep 06 16:27:55.151073 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 627/1231] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:54 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:55.980148 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cec3d6b5-7afd-40af-bc7c-340f7e46f67f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:55.980909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cec3d6b5-7afd-40af-bc7c-340f7e46f67f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:55.987862 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cec3d6b5-7afd-40af-bc7c-340f7e46f67f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:55.988383 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cec3d6b5-7afd-40af-bc7c-340f7e46f67f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:55.988877 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cec3d6b5-7afd-40af-bc7c-340f7e46f67f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:55.989566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cec3d6b5-7afd-40af-bc7c-340f7e46f67f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:55.990007 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cec3d6b5-7afd-40af-bc7c-340f7e46f67f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:55.990422 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cec3d6b5-7afd-40af-bc7c-340f7e46f67f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:56.134212 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cec3d6b5-7afd-40af-bc7c-340f7e46f67f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:56.143366 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cec3d6b5-7afd-40af-bc7c-340f7e46f67f tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1575 microversion: 2.1 time: 0.168545 Sep 06 16:27:56.144327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 605/1232] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:55 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:56.174248 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-52a7cabf-0704-4ff8-8c23-ae3f9ef45fc4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:56.175380 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-52a7cabf-0704-4ff8-8c23-ae3f9ef45fc4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:56.184571 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-52a7cabf-0704-4ff8-8c23-ae3f9ef45fc4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:56.185280 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-52a7cabf-0704-4ff8-8c23-ae3f9ef45fc4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:56.186075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-52a7cabf-0704-4ff8-8c23-ae3f9ef45fc4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:56.186954 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-52a7cabf-0704-4ff8-8c23-ae3f9ef45fc4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:56.187742 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-52a7cabf-0704-4ff8-8c23-ae3f9ef45fc4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:56.188553 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-52a7cabf-0704-4ff8-8c23-ae3f9ef45fc4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:56.389486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-52a7cabf-0704-4ff8-8c23-ae3f9ef45fc4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:56.400071 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-52a7cabf-0704-4ff8-8c23-ae3f9ef45fc4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1368 microversion: 2.1 time: 0.230092 Sep 06 16:27:56.400662 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 628/1233] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:56 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:57.015051 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-56650e25-ee52-480f-8d3e-ff4cf478fbf9 req-0b263bd6-0133-4dea-9170-6d54315db297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993ac4a3-a4e1-43cb-b6da-af83833f1396", "name": "network-vif-plugged", "status": "completed", "tag": "b8387b10-ca79-44d9-bb60-26753cfeeac9"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:57.029147 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-56650e25-ee52-480f-8d3e-ff4cf478fbf9 req-0b263bd6-0133-4dea-9170-6d54315db297 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:57.029836 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-56650e25-ee52-480f-8d3e-ff4cf478fbf9 req-0b263bd6-0133-4dea-9170-6d54315db297 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:57.030345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-56650e25-ee52-480f-8d3e-ff4cf478fbf9 req-0b263bd6-0133-4dea-9170-6d54315db297 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:57.044514 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-56650e25-ee52-480f-8d3e-ff4cf478fbf9 req-0b263bd6-0133-4dea-9170-6d54315db297 service nova] Creating event network-vif-plugged:b8387b10-ca79-44d9-bb60-26753cfeeac9 for instance 993ac4a3-a4e1-43cb-b6da-af83833f1396 on hv-cinder-85221 Sep 06 16:27:57.050148 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-56650e25-ee52-480f-8d3e-ff4cf478fbf9 req-0b263bd6-0133-4dea-9170-6d54315db297 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040172 Sep 06 16:27:57.050980 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 606/1234] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:57.168253 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-42c7137f-3c58-4ce0-8d0d-021e2a386c47 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:57.168928 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-42c7137f-3c58-4ce0-8d0d-021e2a386c47 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:57.175824 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-42c7137f-3c58-4ce0-8d0d-021e2a386c47 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:57.176482 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-42c7137f-3c58-4ce0-8d0d-021e2a386c47 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:57.176923 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-42c7137f-3c58-4ce0-8d0d-021e2a386c47 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:57.177655 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-42c7137f-3c58-4ce0-8d0d-021e2a386c47 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:57.178102 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-42c7137f-3c58-4ce0-8d0d-021e2a386c47 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:57.178520 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-42c7137f-3c58-4ce0-8d0d-021e2a386c47 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:57.349851 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-42c7137f-3c58-4ce0-8d0d-021e2a386c47 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:57.360769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-42c7137f-3c58-4ce0-8d0d-021e2a386c47 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1575 microversion: 2.1 time: 0.196859 Sep 06 16:27:57.361534 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 629/1235] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:57 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1575 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:57.428560 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c2b7de67-30a6-4613-beda-f99e53fa31d6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:57.429296 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c2b7de67-30a6-4613-beda-f99e53fa31d6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:57.435768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c2b7de67-30a6-4613-beda-f99e53fa31d6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:57.436671 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c2b7de67-30a6-4613-beda-f99e53fa31d6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:57.437307 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c2b7de67-30a6-4613-beda-f99e53fa31d6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:57.438211 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c2b7de67-30a6-4613-beda-f99e53fa31d6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:57.438887 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c2b7de67-30a6-4613-beda-f99e53fa31d6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:57.439314 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c2b7de67-30a6-4613-beda-f99e53fa31d6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:57.645558 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c2b7de67-30a6-4613-beda-f99e53fa31d6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:57.653664 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c2b7de67-30a6-4613-beda-f99e53fa31d6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1558 microversion: 2.1 time: 0.231768 Sep 06 16:27:57.654246 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 607/1236] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:57 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1558 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:57.677382 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-56f218f0-40b8-4d86-a312-7ba8c584c331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:57.677881 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-56f218f0-40b8-4d86-a312-7ba8c584c331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:57.684289 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-56f218f0-40b8-4d86-a312-7ba8c584c331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:57.684824 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-56f218f0-40b8-4d86-a312-7ba8c584c331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:57.685283 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-56f218f0-40b8-4d86-a312-7ba8c584c331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:57.685971 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-56f218f0-40b8-4d86-a312-7ba8c584c331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:57.686415 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-56f218f0-40b8-4d86-a312-7ba8c584c331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:57.686852 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-56f218f0-40b8-4d86-a312-7ba8c584c331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:57.768040 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-56f218f0-40b8-4d86-a312-7ba8c584c331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094917 Sep 06 16:27:57.769526 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 630/1237] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 6 16:27:57 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:58.386844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-add60766-f5ca-49c2-abed-49bc8a0cb426 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:58.388147 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-add60766-f5ca-49c2-abed-49bc8a0cb426 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:58.394079 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:58.395564 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-add60766-f5ca-49c2-abed-49bc8a0cb426 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:58.396134 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-add60766-f5ca-49c2-abed-49bc8a0cb426 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:58.396562 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-add60766-f5ca-49c2-abed-49bc8a0cb426 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:58.397624 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-add60766-f5ca-49c2-abed-49bc8a0cb426 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:58.398230 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-add60766-f5ca-49c2-abed-49bc8a0cb426 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:58.398808 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-add60766-f5ca-49c2-abed-49bc8a0cb426 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:58.725607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-add60766-f5ca-49c2-abed-49bc8a0cb426 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:58.733957 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-add60766-f5ca-49c2-abed-49bc8a0cb426 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1575 microversion: 2.1 time: 0.351526 Sep 06 16:27:58.734648 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 608/1238] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:58 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1575 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:59.331687 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-95394f50-b302-47f5-a8c1-e35a2970b244 req-17bcb82d-712f-4f1a-971a-a1ebba934abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d7393f-d0b9-480d-bfe7-36439a86c064", "tag": "b3676286-2353-4328-82d5-f123f7bfbd1d"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:59.359371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-95394f50-b302-47f5-a8c1-e35a2970b244 req-17bcb82d-712f-4f1a-971a-a1ebba934abc service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:59.360470 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-95394f50-b302-47f5-a8c1-e35a2970b244 req-17bcb82d-712f-4f1a-971a-a1ebba934abc service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:59.361532 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-95394f50-b302-47f5-a8c1-e35a2970b244 req-17bcb82d-712f-4f1a-971a-a1ebba934abc service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:59.376577 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-95394f50-b302-47f5-a8c1-e35a2970b244 req-17bcb82d-712f-4f1a-971a-a1ebba934abc service nova] Creating event network-changed:b3676286-2353-4328-82d5-f123f7bfbd1d for instance e7d7393f-d0b9-480d-bfe7-36439a86c064 on hv-cinder-85221 Sep 06 16:27:59.382093 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-95394f50-b302-47f5-a8c1-e35a2970b244 req-17bcb82d-712f-4f1a-971a-a1ebba934abc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065080 Sep 06 16:27:59.383352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 631/1239] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:59.760060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fb1d86f9-aea0-4564-b3fd-9a03433fb258 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:59.761041 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fb1d86f9-aea0-4564-b3fd-9a03433fb258 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:59.770955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb1d86f9-aea0-4564-b3fd-9a03433fb258 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:59.771432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb1d86f9-aea0-4564-b3fd-9a03433fb258 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:59.771881 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb1d86f9-aea0-4564-b3fd-9a03433fb258 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:59.772612 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb1d86f9-aea0-4564-b3fd-9a03433fb258 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:59.773088 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb1d86f9-aea0-4564-b3fd-9a03433fb258 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:59.773505 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fb1d86f9-aea0-4564-b3fd-9a03433fb258 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:00.010439 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fb1d86f9-aea0-4564-b3fd-9a03433fb258 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:00.023582 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fb1d86f9-aea0-4564-b3fd-9a03433fb258 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1562 microversion: 2.1 time: 0.268807 Sep 06 16:28:00.024644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 609/1240] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:59 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1562 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:23.685664 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:28:23.686419 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=45 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:28:23.691473 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-39209706", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-923325397", "security_groups": [{"name": "tempest-secgroup-smoke-1499775823"}], "block_device_mapping_v2": [{"uuid": "69557eab-8e87-47b3-b7c3-5a085d3e26bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9a45d73a-863f-4a67-b2f9-bb887da40d25"}]}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:28:23.816220 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.network.neutron [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] validate_networks() for [('9a45d73a-863f-4a67-b2f9-bb887da40d25', None, None, None, None, None)] {{(pid=120668) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:28:24.231095 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Flavor limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:28:24.231634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Image limits 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:28:24.232293 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Flavor pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:28:24.232790 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Image pref 0:0:0 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:28:24.233384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.virt.hardware [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:28:24.244547 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:24.245060 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:24.245528 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:24.246231 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:24.246710 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:24.247130 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:24.265578 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Getting quotas for project f90ec559752b44b2b67c765488814865. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:28:24.270142 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Getting quotas for user 4d3856b7bb7f4f5bb801952b893bbe35 and project f90ec559752b44b2b67c765488814865. Resources: {'ram', 'cores', 'instances'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:28:24.328992 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Going to run 1 instances... {{(pid=120668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:28:24.331233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69557eab-8e87-47b3-b7c3-5a085d3e26bb',volume_size=None,volume_type=None)] {{(pid=120668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:28:24.472346 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-5cceab50-bfba-4b32-9e4b-fe85ec2ec179 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.788465 Sep 06 16:28:24.473001 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 632/1241] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:28:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:28:24.484405 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fefbcc23-ec19-4b4f-ac3b-92926ad458e1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:24.485078 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fefbcc23-ec19-4b4f-ac3b-92926ad458e1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:24.487097 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=3 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:28:24.488329 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=83 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:28:24.541411 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fefbcc23-ec19-4b4f-ac3b-92926ad458e1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:24.548382 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fefbcc23-ec19-4b4f-ac3b-92926ad458e1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1092 microversion: 2.1 time: 0.068039 Sep 06 16:28:24.549022 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 610/1242] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:24 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:25.573907 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7d3e7124-564d-4900-8d0f-e81517635e11 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:25.574507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7d3e7124-564d-4900-8d0f-e81517635e11 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:25.583207 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d3e7124-564d-4900-8d0f-e81517635e11 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:25.583696 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d3e7124-564d-4900-8d0f-e81517635e11 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:25.584117 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d3e7124-564d-4900-8d0f-e81517635e11 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:25.584830 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d3e7124-564d-4900-8d0f-e81517635e11 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:25.585284 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d3e7124-564d-4900-8d0f-e81517635e11 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:25.585701 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7d3e7124-564d-4900-8d0f-e81517635e11 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:25.655034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7d3e7124-564d-4900-8d0f-e81517635e11 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:25.663095 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7d3e7124-564d-4900-8d0f-e81517635e11 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1190 microversion: 2.1 time: 0.095010 Sep 06 16:28:25.663687 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 633/1243] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:25 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1190 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:26.692268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f2a5e926-0da3-4487-92ef-46bdf13ec114 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:26.693552 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f2a5e926-0da3-4487-92ef-46bdf13ec114 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:26.722021 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f2a5e926-0da3-4487-92ef-46bdf13ec114 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:26.722650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f2a5e926-0da3-4487-92ef-46bdf13ec114 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:26.724870 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f2a5e926-0da3-4487-92ef-46bdf13ec114 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:26.725941 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f2a5e926-0da3-4487-92ef-46bdf13ec114 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:26.741068 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f2a5e926-0da3-4487-92ef-46bdf13ec114 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:26.741801 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f2a5e926-0da3-4487-92ef-46bdf13ec114 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:27.039504 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f2a5e926-0da3-4487-92ef-46bdf13ec114 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:27.047221 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f2a5e926-0da3-4487-92ef-46bdf13ec114 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1276 microversion: 2.1 time: 0.360318 Sep 06 16:28:27.051933 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 611/1244] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:26 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1276 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:28:27.427500 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-3b259694-2ff8-4575-9508-aa716d90acc5 req-58b4d8cd-9dd3-41f4-91ce-98553dea80bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a496a7-a09a-4130-b0be-b6f2be3883c5", "tag": "0f0cce3e-2c90-414d-8d7e-8cb96ae42718"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:28:27.440486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-3b259694-2ff8-4575-9508-aa716d90acc5 req-58b4d8cd-9dd3-41f4-91ce-98553dea80bb service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:27.441441 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-3b259694-2ff8-4575-9508-aa716d90acc5 req-58b4d8cd-9dd3-41f4-91ce-98553dea80bb service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:27.441949 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-3b259694-2ff8-4575-9508-aa716d90acc5 req-58b4d8cd-9dd3-41f4-91ce-98553dea80bb service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:27.454835 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-3b259694-2ff8-4575-9508-aa716d90acc5 req-58b4d8cd-9dd3-41f4-91ce-98553dea80bb service nova] Creating event network-changed:0f0cce3e-2c90-414d-8d7e-8cb96ae42718 for instance 76a496a7-a09a-4130-b0be-b6f2be3883c5 on hv-cinder-85221 Sep 06 16:28:27.459926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-3b259694-2ff8-4575-9508-aa716d90acc5 req-58b4d8cd-9dd3-41f4-91ce-98553dea80bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036492 Sep 06 16:28:27.460709 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 634/1245] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:28:28.073167 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9baf7c85-6acf-41fd-bdcb-0672c30a3fe1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:28.074030 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9baf7c85-6acf-41fd-bdcb-0672c30a3fe1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:28.083474 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9baf7c85-6acf-41fd-bdcb-0672c30a3fe1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:28.084143 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9baf7c85-6acf-41fd-bdcb-0672c30a3fe1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:28.084811 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9baf7c85-6acf-41fd-bdcb-0672c30a3fe1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:28.085794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9baf7c85-6acf-41fd-bdcb-0672c30a3fe1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:28.086447 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9baf7c85-6acf-41fd-bdcb-0672c30a3fe1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:28.087058 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9baf7c85-6acf-41fd-bdcb-0672c30a3fe1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:28.236079 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9baf7c85-6acf-41fd-bdcb-0672c30a3fe1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:28.244909 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9baf7c85-6acf-41fd-bdcb-0672c30a3fe1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1264 microversion: 2.1 time: 0.177324 Sep 06 16:28:28.245488 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 612/1246] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:28 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:29.268735 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fb4325e3-5fe2-4794-a7b6-e8ddb2d4a8f5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:29.269622 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fb4325e3-5fe2-4794-a7b6-e8ddb2d4a8f5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:29.277912 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb4325e3-5fe2-4794-a7b6-e8ddb2d4a8f5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:29.278763 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb4325e3-5fe2-4794-a7b6-e8ddb2d4a8f5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:29.279541 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb4325e3-5fe2-4794-a7b6-e8ddb2d4a8f5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:29.280089 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb4325e3-5fe2-4794-a7b6-e8ddb2d4a8f5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:29.280514 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb4325e3-5fe2-4794-a7b6-e8ddb2d4a8f5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:29.280987 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fb4325e3-5fe2-4794-a7b6-e8ddb2d4a8f5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:29.427108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-fb4325e3-5fe2-4794-a7b6-e8ddb2d4a8f5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:29.436106 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fb4325e3-5fe2-4794-a7b6-e8ddb2d4a8f5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1264 microversion: 2.1 time: 0.171749 Sep 06 16:28:29.436727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 635/1247] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:29 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:30.462316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-f71873ce-2f05-4446-a96f-0c225039e9bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:30.463004 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-f71873ce-2f05-4446-a96f-0c225039e9bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:30.470816 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f71873ce-2f05-4446-a96f-0c225039e9bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:30.471529 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f71873ce-2f05-4446-a96f-0c225039e9bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:30.471970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f71873ce-2f05-4446-a96f-0c225039e9bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:30.472826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f71873ce-2f05-4446-a96f-0c225039e9bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:30.473399 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f71873ce-2f05-4446-a96f-0c225039e9bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:30.473826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-f71873ce-2f05-4446-a96f-0c225039e9bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:30.613062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-f71873ce-2f05-4446-a96f-0c225039e9bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:30.621438 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-f71873ce-2f05-4446-a96f-0c225039e9bc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1264 microversion: 2.1 time: 0.163878 Sep 06 16:28:30.622021 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 613/1248] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:30 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:31.644010 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-51d093ec-f900-4e63-8a45-5dc725047dda tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:31.644606 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-51d093ec-f900-4e63-8a45-5dc725047dda tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:31.651311 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-51d093ec-f900-4e63-8a45-5dc725047dda tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:31.651791 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-51d093ec-f900-4e63-8a45-5dc725047dda tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:31.652223 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-51d093ec-f900-4e63-8a45-5dc725047dda tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:31.652970 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-51d093ec-f900-4e63-8a45-5dc725047dda tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:31.653425 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-51d093ec-f900-4e63-8a45-5dc725047dda tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:31.653844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-51d093ec-f900-4e63-8a45-5dc725047dda tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:31.793279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-51d093ec-f900-4e63-8a45-5dc725047dda tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:31.801661 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-51d093ec-f900-4e63-8a45-5dc725047dda tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1264 microversion: 2.1 time: 0.161757 Sep 06 16:28:31.802220 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 636/1249] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:31 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:32.828169 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6077b89a-f4a7-4a9a-bee6-e29b0a28fa6d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:32.829197 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6077b89a-f4a7-4a9a-bee6-e29b0a28fa6d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:32.839066 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6077b89a-f4a7-4a9a-bee6-e29b0a28fa6d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:32.839600 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6077b89a-f4a7-4a9a-bee6-e29b0a28fa6d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:32.840044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6077b89a-f4a7-4a9a-bee6-e29b0a28fa6d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:32.840768 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6077b89a-f4a7-4a9a-bee6-e29b0a28fa6d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:32.841221 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6077b89a-f4a7-4a9a-bee6-e29b0a28fa6d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:32.841636 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6077b89a-f4a7-4a9a-bee6-e29b0a28fa6d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:32.994807 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6077b89a-f4a7-4a9a-bee6-e29b0a28fa6d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:33.003077 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6077b89a-f4a7-4a9a-bee6-e29b0a28fa6d tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1264 microversion: 2.1 time: 0.181486 Sep 06 16:28:33.003668 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 614/1250] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:32 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:34.026109 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4dd12803-1666-4869-9e40-02ad2fdc98fd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:34.026689 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4dd12803-1666-4869-9e40-02ad2fdc98fd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:34.033562 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dd12803-1666-4869-9e40-02ad2fdc98fd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:34.034078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dd12803-1666-4869-9e40-02ad2fdc98fd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:34.034587 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dd12803-1666-4869-9e40-02ad2fdc98fd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:34.035346 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dd12803-1666-4869-9e40-02ad2fdc98fd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:34.035786 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dd12803-1666-4869-9e40-02ad2fdc98fd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:34.036205 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dd12803-1666-4869-9e40-02ad2fdc98fd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:34.173490 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4dd12803-1666-4869-9e40-02ad2fdc98fd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:34.181776 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4dd12803-1666-4869-9e40-02ad2fdc98fd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1264 microversion: 2.1 time: 0.159664 Sep 06 16:28:34.182344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 637/1251] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:34 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:35.207226 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-85588bb2-e96d-4861-9d2a-2b714d011f37 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:35.208625 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-85588bb2-e96d-4861-9d2a-2b714d011f37 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:35.212376 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:28:35.218668 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85588bb2-e96d-4861-9d2a-2b714d011f37 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:35.219260 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85588bb2-e96d-4861-9d2a-2b714d011f37 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:35.219993 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85588bb2-e96d-4861-9d2a-2b714d011f37 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:35.220884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85588bb2-e96d-4861-9d2a-2b714d011f37 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:35.221585 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85588bb2-e96d-4861-9d2a-2b714d011f37 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:35.222086 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-85588bb2-e96d-4861-9d2a-2b714d011f37 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:35.367962 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-85588bb2-e96d-4861-9d2a-2b714d011f37 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:35.376439 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-85588bb2-e96d-4861-9d2a-2b714d011f37 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1264 microversion: 2.1 time: 0.174297 Sep 06 16:28:35.377062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 615/1252] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:35 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:36.399407 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-03b77a14-6748-4a8c-ae94-106475cf4e02 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:36.399915 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-03b77a14-6748-4a8c-ae94-106475cf4e02 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:36.401850 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:28:36.402518 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=6 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:28:36.409244 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03b77a14-6748-4a8c-ae94-106475cf4e02 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:36.409721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03b77a14-6748-4a8c-ae94-106475cf4e02 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:36.410144 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03b77a14-6748-4a8c-ae94-106475cf4e02 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:36.410829 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03b77a14-6748-4a8c-ae94-106475cf4e02 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:36.411271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03b77a14-6748-4a8c-ae94-106475cf4e02 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:36.411682 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-03b77a14-6748-4a8c-ae94-106475cf4e02 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:36.553573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-03b77a14-6748-4a8c-ae94-106475cf4e02 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:36.562077 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-03b77a14-6748-4a8c-ae94-106475cf4e02 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1264 microversion: 2.1 time: 0.166568 Sep 06 16:28:36.563222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 638/1253] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:36 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:37.589724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d10749a3-a83a-44f9-8ca8-ce32f455c72e tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:37.590407 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d10749a3-a83a-44f9-8ca8-ce32f455c72e tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:37.599919 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d10749a3-a83a-44f9-8ca8-ce32f455c72e tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:37.600550 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d10749a3-a83a-44f9-8ca8-ce32f455c72e tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:37.601164 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d10749a3-a83a-44f9-8ca8-ce32f455c72e tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:37.602072 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d10749a3-a83a-44f9-8ca8-ce32f455c72e tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:37.602668 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d10749a3-a83a-44f9-8ca8-ce32f455c72e tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:37.603232 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d10749a3-a83a-44f9-8ca8-ce32f455c72e tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:37.747938 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-d10749a3-a83a-44f9-8ca8-ce32f455c72e tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:37.759618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d10749a3-a83a-44f9-8ca8-ce32f455c72e tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1264 microversion: 2.1 time: 0.176139 Sep 06 16:28:37.760197 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 616/1254] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:37 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:38.720763 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-98222e94-0609-4f94-9676-ce5da711c163 req-53616776-0aa9-49f7-9eee-890b851882c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a496a7-a09a-4130-b0be-b6f2be3883c5", "name": "network-vif-plugged", "status": "completed", "tag": "0f0cce3e-2c90-414d-8d7e-8cb96ae42718"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:28:38.731191 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-98222e94-0609-4f94-9676-ce5da711c163 req-53616776-0aa9-49f7-9eee-890b851882c4 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:38.731684 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-98222e94-0609-4f94-9676-ce5da711c163 req-53616776-0aa9-49f7-9eee-890b851882c4 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:38.732105 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-98222e94-0609-4f94-9676-ce5da711c163 req-53616776-0aa9-49f7-9eee-890b851882c4 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:38.743863 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-98222e94-0609-4f94-9676-ce5da711c163 req-53616776-0aa9-49f7-9eee-890b851882c4 service nova] Creating event network-vif-plugged:0f0cce3e-2c90-414d-8d7e-8cb96ae42718 for instance 76a496a7-a09a-4130-b0be-b6f2be3883c5 on hv-cinder-85221 Sep 06 16:28:38.748933 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-98222e94-0609-4f94-9676-ce5da711c163 req-53616776-0aa9-49f7-9eee-890b851882c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031977 Sep 06 16:28:38.749627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 639/1255] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:28:38.782524 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-eba1e822-40b6-4a11-8c32-b3214f72efb8 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:38.783085 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-eba1e822-40b6-4a11-8c32-b3214f72efb8 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:38.789964 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eba1e822-40b6-4a11-8c32-b3214f72efb8 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:38.790443 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eba1e822-40b6-4a11-8c32-b3214f72efb8 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:38.790870 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eba1e822-40b6-4a11-8c32-b3214f72efb8 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:38.791651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eba1e822-40b6-4a11-8c32-b3214f72efb8 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:38.792095 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eba1e822-40b6-4a11-8c32-b3214f72efb8 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:38.792507 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-eba1e822-40b6-4a11-8c32-b3214f72efb8 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:38.933134 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-eba1e822-40b6-4a11-8c32-b3214f72efb8 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:38.941370 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-eba1e822-40b6-4a11-8c32-b3214f72efb8 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1264 microversion: 2.1 time: 0.162707 Sep 06 16:28:38.941944 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 617/1256] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:38 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:39.970686 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-93ef4380-f03f-42cf-890b-7559f78cc7ed tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:39.971809 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-93ef4380-f03f-42cf-890b-7559f78cc7ed tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:39.986002 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93ef4380-f03f-42cf-890b-7559f78cc7ed tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:39.986745 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93ef4380-f03f-42cf-890b-7559f78cc7ed tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:39.987363 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93ef4380-f03f-42cf-890b-7559f78cc7ed tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:39.988270 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93ef4380-f03f-42cf-890b-7559f78cc7ed tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:39.988958 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93ef4380-f03f-42cf-890b-7559f78cc7ed tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:39.989674 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-93ef4380-f03f-42cf-890b-7559f78cc7ed tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:40.140170 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-93ef4380-f03f-42cf-890b-7559f78cc7ed tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:40.150620 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-93ef4380-f03f-42cf-890b-7559f78cc7ed tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1264 microversion: 2.1 time: 0.187646 Sep 06 16:28:40.151451 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 640/1257] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:39 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:41.179498 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4e3eea8d-83f7-4d15-9208-c3714f735c8a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:41.180107 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4e3eea8d-83f7-4d15-9208-c3714f735c8a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:41.187148 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4e3eea8d-83f7-4d15-9208-c3714f735c8a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:41.187628 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4e3eea8d-83f7-4d15-9208-c3714f735c8a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:41.188066 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4e3eea8d-83f7-4d15-9208-c3714f735c8a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:41.188791 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4e3eea8d-83f7-4d15-9208-c3714f735c8a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:41.189251 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4e3eea8d-83f7-4d15-9208-c3714f735c8a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:41.189678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4e3eea8d-83f7-4d15-9208-c3714f735c8a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:41.338244 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-4e3eea8d-83f7-4d15-9208-c3714f735c8a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:41.346297 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4e3eea8d-83f7-4d15-9208-c3714f735c8a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1451 microversion: 2.1 time: 0.171131 Sep 06 16:28:41.346842 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 618/1258] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:41 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:41.368967 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-ce8ad9f7-2ecf-4899-ba53-e8da56eea5f2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:41.369604 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-ce8ad9f7-2ecf-4899-ba53-e8da56eea5f2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:41.376363 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce8ad9f7-2ecf-4899-ba53-e8da56eea5f2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:41.376943 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce8ad9f7-2ecf-4899-ba53-e8da56eea5f2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:41.377379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce8ad9f7-2ecf-4899-ba53-e8da56eea5f2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:41.378071 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce8ad9f7-2ecf-4899-ba53-e8da56eea5f2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:41.378520 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce8ad9f7-2ecf-4899-ba53-e8da56eea5f2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:41.378939 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-ce8ad9f7-2ecf-4899-ba53-e8da56eea5f2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:41.516466 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-ce8ad9f7-2ecf-4899-ba53-e8da56eea5f2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:41.530965 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-ce8ad9f7-2ecf-4899-ba53-e8da56eea5f2 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1451 microversion: 2.1 time: 0.165974 Sep 06 16:28:41.531764 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 641/1259] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:28:41 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:43.608339 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-8fe32007-8236-4671-a6cc-a0d6fd5e7ff3 req-25c71858-bf68-47f4-8284-7072cf98ca8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a496a7-a09a-4130-b0be-b6f2be3883c5", "tag": "0f0cce3e-2c90-414d-8d7e-8cb96ae42718"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:28:43.618017 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-8fe32007-8236-4671-a6cc-a0d6fd5e7ff3 req-25c71858-bf68-47f4-8284-7072cf98ca8c service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:43.618604 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-8fe32007-8236-4671-a6cc-a0d6fd5e7ff3 req-25c71858-bf68-47f4-8284-7072cf98ca8c service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:43.619030 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-8fe32007-8236-4671-a6cc-a0d6fd5e7ff3 req-25c71858-bf68-47f4-8284-7072cf98ca8c service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:43.630472 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-8fe32007-8236-4671-a6cc-a0d6fd5e7ff3 req-25c71858-bf68-47f4-8284-7072cf98ca8c service nova] Creating event network-changed:0f0cce3e-2c90-414d-8d7e-8cb96ae42718 for instance 76a496a7-a09a-4130-b0be-b6f2be3883c5 on hv-cinder-85221 Sep 06 16:28:43.636080 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-8fe32007-8236-4671-a6cc-a0d6fd5e7ff3 req-25c71858-bf68-47f4-8284-7072cf98ca8c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157024 Sep 06 16:28:43.636689 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 619/1260] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:29:28.854793 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-35741ab0-7f75-4650-a55d-a4995f09b0fe tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:28.855822 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-35741ab0-7f75-4650-a55d-a4995f09b0fe tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:28.859694 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:29:28.860725 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=48 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:29:28.868916 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35741ab0-7f75-4650-a55d-a4995f09b0fe tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:28.869394 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35741ab0-7f75-4650-a55d-a4995f09b0fe tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:28.869816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35741ab0-7f75-4650-a55d-a4995f09b0fe tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:28.870507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35741ab0-7f75-4650-a55d-a4995f09b0fe tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:28.870948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35741ab0-7f75-4650-a55d-a4995f09b0fe tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:28.871357 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-35741ab0-7f75-4650-a55d-a4995f09b0fe tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:28.897709 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-35741ab0-7f75-4650-a55d-a4995f09b0fe tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064/ips" status: 200 len: 149 microversion: 2.1 time: 0.048488 Sep 06 16:29:28.898298 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 642/1261] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 6 16:29:28 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:29:30.282280 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=22 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:29:30.283018 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=50 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:29:30.287700 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-30d20426-7def-4b43-adbc-46d80c4158e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b67816f-d280-4726-962e-514e85b98946"}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:29:30.290263 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-30d20426-7def-4b43-adbc-46d80c4158e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:30.297516 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-30d20426-7def-4b43-adbc-46d80c4158e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:30.298377 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-30d20426-7def-4b43-adbc-46d80c4158e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:30.298810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-30d20426-7def-4b43-adbc-46d80c4158e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:30.299518 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-30d20426-7def-4b43-adbc-46d80c4158e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:30.299968 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-30d20426-7def-4b43-adbc-46d80c4158e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:30.300519 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-30d20426-7def-4b43-adbc-46d80c4158e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:30.591861 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-30d20426-7def-4b43-adbc-46d80c4158e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310925 Sep 06 16:29:30.592479 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 620/1262] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:29:30 2022] POST /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:29:38.184715 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0dd06a7c-c1f7-4847-91f6-52f07f55adec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: .version_select at 0x7f83e9501b80>, body: {"keypair": {"name": "tempest-keypair-418181524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxj2xPJX3KgpnKENaX1FYITl+5sXMmfgo3bo2miuODfsS0bqQ2fbUbCdLkQGQoN/m/aEgG2x9I445BpBVeEYXEOKUonUdajALsjoLWB3tQbZSmkTYpj9rPwQYbdygUlkg=="}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:29:38.202535 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-0dd06a7c-c1f7-4847-91f6-52f07f55adec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for project 5c722f58536f492aa4eb96085452def4. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:29:38.206700 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-0dd06a7c-c1f7-4847-91f6-52f07f55adec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for user 523faa1ac64e4044b9fb651ec28249d9 and project 5c722f58536f492aa4eb96085452def4. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:29:38.231993 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0dd06a7c-c1f7-4847-91f6-52f07f55adec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051186 Sep 06 16:29:38.232622 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 643/1263] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 6 16:29:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:29:39.638780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2001353277", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4084decc-71da-4dac-8299-c3181b61526b"}], "security_groups": [{"name": "tempest-securitygroup--626577120"}], "key_name": "tempest-keypair-418181524", "user_data": "}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:29:39.756335 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] validate_networks() for [('4084decc-71da-4dac-8299-c3181b61526b', None, None, None, None, None)] {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:29:40.236410 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:29:40.236864 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:29:40.237335 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:29:40.237736 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:29:40.238137 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:29:40.248113 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:40.248588 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:40.249028 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:40.249774 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:40.250213 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:40.250606 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:40.269882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for project 5c722f58536f492aa4eb96085452def4. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:29:40.274614 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for user 523faa1ac64e4044b9fb651ec28249d9 and project 5c722f58536f492aa4eb96085452def4. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:29:40.287245 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:29:40.289727 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:29:40.347609 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-643651a8-cb97-4d5d-908c-07570428e151 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.715421 Sep 06 16:29:40.348882 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 621/1264] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:29:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:29:40.362817 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=4 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:29:40.367824 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a7f25d7d-1731-49b3-835b-713815ac0fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:40.368443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a7f25d7d-1731-49b3-835b-713815ac0fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:40.426669 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a7f25d7d-1731-49b3-835b-713815ac0fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:40.434173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a7f25d7d-1731-49b3-835b-713815ac0fbb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1241 microversion: 2.1 time: 0.071996 Sep 06 16:29:40.434974 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 644/1265] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:40 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:41.460676 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ba72c3a0-f528-493a-90a3-9ce581e42c33 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:41.461408 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-ba72c3a0-f528-493a-90a3-9ce581e42c33 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:41.469361 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba72c3a0-f528-493a-90a3-9ce581e42c33 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:41.469900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba72c3a0-f528-493a-90a3-9ce581e42c33 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:41.470305 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba72c3a0-f528-493a-90a3-9ce581e42c33 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:41.471275 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba72c3a0-f528-493a-90a3-9ce581e42c33 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:41.471738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba72c3a0-f528-493a-90a3-9ce581e42c33 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:41.472185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-ba72c3a0-f528-493a-90a3-9ce581e42c33 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:41.542391 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-ba72c3a0-f528-493a-90a3-9ce581e42c33 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:41.552365 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ba72c3a0-f528-493a-90a3-9ce581e42c33 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1293 microversion: 2.1 time: 0.097226 Sep 06 16:29:41.553016 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 622/1266] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:41 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:42.575685 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-9b9b5f96-fdc0-4abd-a7d2-e191000f1331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:42.576326 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-9b9b5f96-fdc0-4abd-a7d2-e191000f1331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:42.582974 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b9b5f96-fdc0-4abd-a7d2-e191000f1331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:42.583461 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b9b5f96-fdc0-4abd-a7d2-e191000f1331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:42.583900 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b9b5f96-fdc0-4abd-a7d2-e191000f1331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:42.584596 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b9b5f96-fdc0-4abd-a7d2-e191000f1331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:42.585087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b9b5f96-fdc0-4abd-a7d2-e191000f1331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:42.585507 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-9b9b5f96-fdc0-4abd-a7d2-e191000f1331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:42.651909 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-9b9b5f96-fdc0-4abd-a7d2-e191000f1331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:42.661203 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-9b9b5f96-fdc0-4abd-a7d2-e191000f1331 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1299 microversion: 2.1 time: 0.089276 Sep 06 16:29:42.661869 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 645/1267] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:42 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:43.536445 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-59959359-ca79-477c-9477-4815a9adb618 req-dd38b7d9-3fad-49a5-8497-135078752402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a83e1d-7bb7-4e42-8a31-530ded48a350", "tag": "6f30db3a-4d6c-4aa0-a564-c22b0d45dd9b"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:29:43.554089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-59959359-ca79-477c-9477-4815a9adb618 req-dd38b7d9-3fad-49a5-8497-135078752402 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:43.554847 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-59959359-ca79-477c-9477-4815a9adb618 req-dd38b7d9-3fad-49a5-8497-135078752402 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:43.555276 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-59959359-ca79-477c-9477-4815a9adb618 req-dd38b7d9-3fad-49a5-8497-135078752402 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:43.566794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-59959359-ca79-477c-9477-4815a9adb618 req-dd38b7d9-3fad-49a5-8497-135078752402 service nova] Creating event network-changed:6f30db3a-4d6c-4aa0-a564-c22b0d45dd9b for instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 on hv-cinder-85221 Sep 06 16:29:43.572716 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-59959359-ca79-477c-9477-4815a9adb618 req-dd38b7d9-3fad-49a5-8497-135078752402 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044939 Sep 06 16:29:43.573489 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 623/1268] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:29:43.685035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-128cd32d-f7f5-49f6-998a-5027099da2cc tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:43.685563 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-128cd32d-f7f5-49f6-998a-5027099da2cc tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:43.692465 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-128cd32d-f7f5-49f6-998a-5027099da2cc tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:43.692983 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-128cd32d-f7f5-49f6-998a-5027099da2cc tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:43.693414 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-128cd32d-f7f5-49f6-998a-5027099da2cc tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:43.694112 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-128cd32d-f7f5-49f6-998a-5027099da2cc tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:43.694564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-128cd32d-f7f5-49f6-998a-5027099da2cc tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:43.694982 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-128cd32d-f7f5-49f6-998a-5027099da2cc tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:43.831529 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-128cd32d-f7f5-49f6-998a-5027099da2cc tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:43.841289 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-128cd32d-f7f5-49f6-998a-5027099da2cc tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1366 microversion: 2.1 time: 0.160201 Sep 06 16:29:43.842250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 646/1269] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:43 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:44.866512 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-647bbe9c-3c4e-4574-b1d5-939fa67f568e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:44.867218 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-647bbe9c-3c4e-4574-b1d5-939fa67f568e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:44.874294 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-647bbe9c-3c4e-4574-b1d5-939fa67f568e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:44.874773 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-647bbe9c-3c4e-4574-b1d5-939fa67f568e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:44.875208 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-647bbe9c-3c4e-4574-b1d5-939fa67f568e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:44.875895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-647bbe9c-3c4e-4574-b1d5-939fa67f568e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:44.876345 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-647bbe9c-3c4e-4574-b1d5-939fa67f568e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:44.876784 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-647bbe9c-3c4e-4574-b1d5-939fa67f568e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:45.016422 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-647bbe9c-3c4e-4574-b1d5-939fa67f568e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:45.024547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-647bbe9c-3c4e-4574-b1d5-939fa67f568e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1366 microversion: 2.1 time: 0.162295 Sep 06 16:29:45.025165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 624/1270] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:44 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:46.050106 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f076be8e-a902-4047-b60c-2cb0666b8b22 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:46.052919 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f076be8e-a902-4047-b60c-2cb0666b8b22 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:46.059032 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f076be8e-a902-4047-b60c-2cb0666b8b22 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:46.059691 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f076be8e-a902-4047-b60c-2cb0666b8b22 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:46.060382 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f076be8e-a902-4047-b60c-2cb0666b8b22 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:46.061569 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f076be8e-a902-4047-b60c-2cb0666b8b22 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:46.062341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f076be8e-a902-4047-b60c-2cb0666b8b22 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:46.062838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f076be8e-a902-4047-b60c-2cb0666b8b22 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:46.228257 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f076be8e-a902-4047-b60c-2cb0666b8b22 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:46.236247 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f076be8e-a902-4047-b60c-2cb0666b8b22 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1366 microversion: 2.1 time: 0.190531 Sep 06 16:29:46.236848 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 647/1271] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:46 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:47.259257 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e1fa8394-9816-4f69-8ef4-177b2dad8ddb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:47.259878 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e1fa8394-9816-4f69-8ef4-177b2dad8ddb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:47.266793 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e1fa8394-9816-4f69-8ef4-177b2dad8ddb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:47.267273 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e1fa8394-9816-4f69-8ef4-177b2dad8ddb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:47.267712 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e1fa8394-9816-4f69-8ef4-177b2dad8ddb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:47.268437 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e1fa8394-9816-4f69-8ef4-177b2dad8ddb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:47.268925 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e1fa8394-9816-4f69-8ef4-177b2dad8ddb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:47.269368 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e1fa8394-9816-4f69-8ef4-177b2dad8ddb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:47.421279 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e1fa8394-9816-4f69-8ef4-177b2dad8ddb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:47.430688 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e1fa8394-9816-4f69-8ef4-177b2dad8ddb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1366 microversion: 2.1 time: 0.175303 Sep 06 16:29:47.431306 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 625/1272] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:47 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:48.453652 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-318849a4-7d44-4ce5-a555-cb0665aaa6ef tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:48.454279 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-318849a4-7d44-4ce5-a555-cb0665aaa6ef tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:48.461097 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-318849a4-7d44-4ce5-a555-cb0665aaa6ef tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:48.461581 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-318849a4-7d44-4ce5-a555-cb0665aaa6ef tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:48.462006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-318849a4-7d44-4ce5-a555-cb0665aaa6ef tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:48.462716 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-318849a4-7d44-4ce5-a555-cb0665aaa6ef tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:48.463157 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-318849a4-7d44-4ce5-a555-cb0665aaa6ef tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:48.463570 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-318849a4-7d44-4ce5-a555-cb0665aaa6ef tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:48.847478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-318849a4-7d44-4ce5-a555-cb0665aaa6ef tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:48.856268 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-318849a4-7d44-4ce5-a555-cb0665aaa6ef tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1366 microversion: 2.1 time: 0.406439 Sep 06 16:29:48.856887 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 648/1273] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:48 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:49.269187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-bc8ecad3-cda3-4ec5-bbc1-ce0acd82373d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:49.269989 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-bc8ecad3-cda3-4ec5-bbc1-ce0acd82373d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:49.276505 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-472aa154-ac84-4d7b-ad01-97dc71ccf0d1 req-324b6b12-fa77-4450-a817-ef2f541d91ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993ac4a3-a4e1-43cb-b6da-af83833f1396", "tag": "b8387b10-ca79-44d9-bb60-26753cfeeac9"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:29:49.277575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc8ecad3-cda3-4ec5-bbc1-ce0acd82373d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:49.278182 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc8ecad3-cda3-4ec5-bbc1-ce0acd82373d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:49.279072 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc8ecad3-cda3-4ec5-bbc1-ce0acd82373d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:49.280027 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc8ecad3-cda3-4ec5-bbc1-ce0acd82373d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:49.280689 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc8ecad3-cda3-4ec5-bbc1-ce0acd82373d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:49.282018 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc8ecad3-cda3-4ec5-bbc1-ce0acd82373d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:49.285516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-472aa154-ac84-4d7b-ad01-97dc71ccf0d1 req-324b6b12-fa77-4450-a817-ef2f541d91ec service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:49.286093 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-472aa154-ac84-4d7b-ad01-97dc71ccf0d1 req-324b6b12-fa77-4450-a817-ef2f541d91ec service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:49.286660 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-472aa154-ac84-4d7b-ad01-97dc71ccf0d1 req-324b6b12-fa77-4450-a817-ef2f541d91ec service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:49.299293 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-472aa154-ac84-4d7b-ad01-97dc71ccf0d1 req-324b6b12-fa77-4450-a817-ef2f541d91ec service nova] Creating event network-changed:b8387b10-ca79-44d9-bb60-26753cfeeac9 for instance 993ac4a3-a4e1-43cb-b6da-af83833f1396 on hv-cinder-85221 Sep 06 16:29:49.304974 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-472aa154-ac84-4d7b-ad01-97dc71ccf0d1 req-324b6b12-fa77-4450-a817-ef2f541d91ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033519 Sep 06 16:29:49.305611 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 649/1274] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:29:49.319361 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-bc8ecad3-cda3-4ec5-bbc1-ce0acd82373d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Going to try to terminate instance {{(pid=120669) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:29:49.410788 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-bc8ecad3-cda3-4ec5-bbc1-ce0acd82373d tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "DELETE /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 204 len: 0 microversion: 2.1 time: 0.146195 Sep 06 16:29:49.415386 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 626/1275] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:29:49 2022] DELETE /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:29:49.421864 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f0908b2b-5e2c-441f-9436-1fb8db61697c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:49.422939 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f0908b2b-5e2c-441f-9436-1fb8db61697c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:49.429947 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f0908b2b-5e2c-441f-9436-1fb8db61697c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:49.430569 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f0908b2b-5e2c-441f-9436-1fb8db61697c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:49.431264 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f0908b2b-5e2c-441f-9436-1fb8db61697c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:49.432037 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f0908b2b-5e2c-441f-9436-1fb8db61697c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:49.432559 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f0908b2b-5e2c-441f-9436-1fb8db61697c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:49.433190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f0908b2b-5e2c-441f-9436-1fb8db61697c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:49.611218 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f0908b2b-5e2c-441f-9436-1fb8db61697c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:49.619193 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f0908b2b-5e2c-441f-9436-1fb8db61697c tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.201891 Sep 06 16:29:49.619757 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 650/1276] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:49 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:29:49.879804 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1c5f6ca3-a3e6-4204-9d6a-8fc131a0a8bb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:49.880525 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1c5f6ca3-a3e6-4204-9d6a-8fc131a0a8bb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:49.887112 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1c5f6ca3-a3e6-4204-9d6a-8fc131a0a8bb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:49.887701 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1c5f6ca3-a3e6-4204-9d6a-8fc131a0a8bb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:49.888145 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1c5f6ca3-a3e6-4204-9d6a-8fc131a0a8bb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:49.888984 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1c5f6ca3-a3e6-4204-9d6a-8fc131a0a8bb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:49.889598 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1c5f6ca3-a3e6-4204-9d6a-8fc131a0a8bb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:49.889994 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1c5f6ca3-a3e6-4204-9d6a-8fc131a0a8bb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:50.029166 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1c5f6ca3-a3e6-4204-9d6a-8fc131a0a8bb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:50.037891 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1c5f6ca3-a3e6-4204-9d6a-8fc131a0a8bb tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1366 microversion: 2.1 time: 0.162443 Sep 06 16:29:50.038561 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 627/1277] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:49 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:50.643000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-53e352bd-48ac-4aee-b3dc-0b764d3ef331 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:50.644228 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-53e352bd-48ac-4aee-b3dc-0b764d3ef331 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:50.646950 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=6 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:29:50.652844 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-53e352bd-48ac-4aee-b3dc-0b764d3ef331 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:50.653331 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-53e352bd-48ac-4aee-b3dc-0b764d3ef331 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:50.653767 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-53e352bd-48ac-4aee-b3dc-0b764d3ef331 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:50.654453 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-53e352bd-48ac-4aee-b3dc-0b764d3ef331 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:50.654897 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-53e352bd-48ac-4aee-b3dc-0b764d3ef331 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:50.655309 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-53e352bd-48ac-4aee-b3dc-0b764d3ef331 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:50.795431 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-53e352bd-48ac-4aee-b3dc-0b764d3ef331 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:50.804082 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-53e352bd-48ac-4aee-b3dc-0b764d3ef331 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1568 microversion: 2.1 time: 0.165092 Sep 06 16:29:50.804668 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 651/1278] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:50 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:51.062900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5a66f3ca-34ec-4e3c-94a4-78d85da160a0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:51.063691 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5a66f3ca-34ec-4e3c-94a4-78d85da160a0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:51.066131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:29:51.069187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=6 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:29:51.074575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5a66f3ca-34ec-4e3c-94a4-78d85da160a0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:51.075481 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5a66f3ca-34ec-4e3c-94a4-78d85da160a0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:51.076208 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5a66f3ca-34ec-4e3c-94a4-78d85da160a0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:51.077070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5a66f3ca-34ec-4e3c-94a4-78d85da160a0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:51.077622 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5a66f3ca-34ec-4e3c-94a4-78d85da160a0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:51.078136 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5a66f3ca-34ec-4e3c-94a4-78d85da160a0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:51.261713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-c8a3250a-25f6-49a0-9f36-d03212478644 req-5ec42bc4-d126-4583-a2d9-f343c0aa8292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a83e1d-7bb7-4e42-8a31-530ded48a350", "name": "network-vif-plugged", "status": "completed", "tag": "6f30db3a-4d6c-4aa0-a564-c22b0d45dd9b"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:29:51.273736 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c8a3250a-25f6-49a0-9f36-d03212478644 req-5ec42bc4-d126-4583-a2d9-f343c0aa8292 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:51.274579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c8a3250a-25f6-49a0-9f36-d03212478644 req-5ec42bc4-d126-4583-a2d9-f343c0aa8292 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:51.275264 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-c8a3250a-25f6-49a0-9f36-d03212478644 req-5ec42bc4-d126-4583-a2d9-f343c0aa8292 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:51.287824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5a66f3ca-34ec-4e3c-94a4-78d85da160a0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:51.296088 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5a66f3ca-34ec-4e3c-94a4-78d85da160a0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1366 microversion: 2.1 time: 0.237127 Sep 06 16:29:51.304897 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 628/1279] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:51 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:51.305618 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-c8a3250a-25f6-49a0-9f36-d03212478644 req-5ec42bc4-d126-4583-a2d9-f343c0aa8292 service nova] Creating event network-vif-plugged:6f30db3a-4d6c-4aa0-a564-c22b0d45dd9b for instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 on hv-cinder-85221 Sep 06 16:29:51.312130 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-c8a3250a-25f6-49a0-9f36-d03212478644 req-5ec42bc4-d126-4583-a2d9-f343c0aa8292 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057725 Sep 06 16:29:51.312948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 652/1280] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:29:51.827828 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-0c32beb8-3326-473a-b9e0-3c1bd41f6276 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:51.828976 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-0c32beb8-3326-473a-b9e0-3c1bd41f6276 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:51.838355 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0c32beb8-3326-473a-b9e0-3c1bd41f6276 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:51.839089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0c32beb8-3326-473a-b9e0-3c1bd41f6276 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:51.839737 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0c32beb8-3326-473a-b9e0-3c1bd41f6276 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:51.840964 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0c32beb8-3326-473a-b9e0-3c1bd41f6276 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:51.841773 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0c32beb8-3326-473a-b9e0-3c1bd41f6276 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:51.842504 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-0c32beb8-3326-473a-b9e0-3c1bd41f6276 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:52.033991 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-0c32beb8-3326-473a-b9e0-3c1bd41f6276 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:52.045800 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-0c32beb8-3326-473a-b9e0-3c1bd41f6276 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1449 microversion: 2.1 time: 0.221949 Sep 06 16:29:52.046418 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 629/1281] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:51 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1449 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:52.271880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-83416eaa-c864-4421-833d-1b1123889409 req-42702750-9551-45ca-be2f-943c632e675a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993ac4a3-a4e1-43cb-b6da-af83833f1396", "name": "network-vif-deleted", "tag": "b8387b10-ca79-44d9-bb60-26753cfeeac9"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:29:52.285111 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-83416eaa-c864-4421-833d-1b1123889409 req-42702750-9551-45ca-be2f-943c632e675a service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:52.285727 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-83416eaa-c864-4421-833d-1b1123889409 req-42702750-9551-45ca-be2f-943c632e675a service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:52.286233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-83416eaa-c864-4421-833d-1b1123889409 req-42702750-9551-45ca-be2f-943c632e675a service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:52.298880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-83416eaa-c864-4421-833d-1b1123889409 req-42702750-9551-45ca-be2f-943c632e675a service nova] Creating event network-vif-deleted:b8387b10-ca79-44d9-bb60-26753cfeeac9 for instance 993ac4a3-a4e1-43cb-b6da-af83833f1396 on hv-cinder-85221 Sep 06 16:29:52.304639 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-83416eaa-c864-4421-833d-1b1123889409 req-42702750-9551-45ca-be2f-943c632e675a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040742 Sep 06 16:29:52.305285 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 653/1282] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:29:52.322450 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-7ec20d61-09af-46a5-8501-c1095fcd2ac4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:52.323064 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-7ec20d61-09af-46a5-8501-c1095fcd2ac4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:52.330428 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ec20d61-09af-46a5-8501-c1095fcd2ac4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:52.330958 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ec20d61-09af-46a5-8501-c1095fcd2ac4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:52.331373 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ec20d61-09af-46a5-8501-c1095fcd2ac4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:52.332115 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ec20d61-09af-46a5-8501-c1095fcd2ac4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:52.332566 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ec20d61-09af-46a5-8501-c1095fcd2ac4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:52.333032 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-7ec20d61-09af-46a5-8501-c1095fcd2ac4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:52.476505 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-7ec20d61-09af-46a5-8501-c1095fcd2ac4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:52.485510 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-7ec20d61-09af-46a5-8501-c1095fcd2ac4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1366 microversion: 2.1 time: 0.169569 Sep 06 16:29:52.486120 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 630/1283] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:52 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:53.071729 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-7f5e49b8-4d02-4359-a1e6-d738960553a6 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:53.072420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-7f5e49b8-4d02-4359-a1e6-d738960553a6 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:53.079109 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7f5e49b8-4d02-4359-a1e6-d738960553a6 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:53.079602 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7f5e49b8-4d02-4359-a1e6-d738960553a6 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:53.080028 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7f5e49b8-4d02-4359-a1e6-d738960553a6 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:53.080778 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7f5e49b8-4d02-4359-a1e6-d738960553a6 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:53.081239 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7f5e49b8-4d02-4359-a1e6-d738960553a6 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:53.081654 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-7f5e49b8-4d02-4359-a1e6-d738960553a6 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:53.147462 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-7f5e49b8-4d02-4359-a1e6-d738960553a6 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:53.157102 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-7f5e49b8-4d02-4359-a1e6-d738960553a6 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1219 microversion: 2.1 time: 0.089717 Sep 06 16:29:53.157693 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 654/1284] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:53 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:29:53.507650 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b7a0fa0d-2b53-4534-849c-9ed14180fa27 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:53.508555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b7a0fa0d-2b53-4534-849c-9ed14180fa27 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:53.519875 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b7a0fa0d-2b53-4534-849c-9ed14180fa27 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:53.520354 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b7a0fa0d-2b53-4534-849c-9ed14180fa27 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:53.520894 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b7a0fa0d-2b53-4534-849c-9ed14180fa27 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:53.521622 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b7a0fa0d-2b53-4534-849c-9ed14180fa27 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:53.522068 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b7a0fa0d-2b53-4534-849c-9ed14180fa27 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:53.522487 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b7a0fa0d-2b53-4534-849c-9ed14180fa27 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:53.665165 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-b7a0fa0d-2b53-4534-849c-9ed14180fa27 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:53.673503 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b7a0fa0d-2b53-4534-849c-9ed14180fa27 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1556 microversion: 2.1 time: 0.169859 Sep 06 16:29:53.674076 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 631/1285] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:53 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:53.696032 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-544099a7-853b-42ac-8186-f2800ad55b44 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:53.696693 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-544099a7-853b-42ac-8186-f2800ad55b44 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:53.703501 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-544099a7-853b-42ac-8186-f2800ad55b44 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:53.703985 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-544099a7-853b-42ac-8186-f2800ad55b44 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:53.704401 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-544099a7-853b-42ac-8186-f2800ad55b44 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:53.705162 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-544099a7-853b-42ac-8186-f2800ad55b44 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:53.705609 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-544099a7-853b-42ac-8186-f2800ad55b44 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:53.706042 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-544099a7-853b-42ac-8186-f2800ad55b44 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:53.798127 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-544099a7-853b-42ac-8186-f2800ad55b44 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105658 Sep 06 16:29:53.798712 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 655/1286] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 6 16:29:53 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:29:54.180470 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:54.181415 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:54.189833 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:54.190438 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:54.190955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:54.191780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:54.192315 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:54.192743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:54.226392 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:54.226875 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:54.227325 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:54.227907 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lazy-loading 'fault' on Instance uuid 993ac4a3-a4e1-43cb-b6da-af83833f1396 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:29:54.284007 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bab2b0d23a47e19c4a50e72fc75714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b0e99f20e842c29ec46e5731ae9d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:54.292350 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6b503681-614f-46bd-a563-29a8c8efe788 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 200 len: 1224 microversion: 2.1 time: 0.115915 Sep 06 16:29:54.293011 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 632/1287] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:54 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:29:54.835329 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-7c4bc0bc-31dd-4b34-bb26-632fbb4621b5 req-3cfee356-da0c-43d4-9aec-81a2fc823d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a83e1d-7bb7-4e42-8a31-530ded48a350", "tag": "6f30db3a-4d6c-4aa0-a564-c22b0d45dd9b"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:29:54.845057 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-7c4bc0bc-31dd-4b34-bb26-632fbb4621b5 req-3cfee356-da0c-43d4-9aec-81a2fc823d87 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:54.845528 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-7c4bc0bc-31dd-4b34-bb26-632fbb4621b5 req-3cfee356-da0c-43d4-9aec-81a2fc823d87 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:54.845959 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-7c4bc0bc-31dd-4b34-bb26-632fbb4621b5 req-3cfee356-da0c-43d4-9aec-81a2fc823d87 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:54.860056 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-7c4bc0bc-31dd-4b34-bb26-632fbb4621b5 req-3cfee356-da0c-43d4-9aec-81a2fc823d87 service nova] Creating event network-changed:6f30db3a-4d6c-4aa0-a564-c22b0d45dd9b for instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 on hv-cinder-85221 Sep 06 16:29:54.865268 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-7c4bc0bc-31dd-4b34-bb26-632fbb4621b5 req-3cfee356-da0c-43d4-9aec-81a2fc823d87 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034063 Sep 06 16:29:54.865890 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 656/1288] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:29:55.320906 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-776ddff2-c7af-4344-a2dd-86bda3d50e11 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:55.321946 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-776ddff2-c7af-4344-a2dd-86bda3d50e11 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] [instance: 993ac4a3-a4e1-43cb-b6da-af83833f1396] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:55.333351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-776ddff2-c7af-4344-a2dd-86bda3d50e11 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:55.334048 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-776ddff2-c7af-4344-a2dd-86bda3d50e11 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:55.334769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-776ddff2-c7af-4344-a2dd-86bda3d50e11 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:55.335932 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-776ddff2-c7af-4344-a2dd-86bda3d50e11 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:55.336643 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-776ddff2-c7af-4344-a2dd-86bda3d50e11 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:55.337327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-776ddff2-c7af-4344-a2dd-86bda3d50e11 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:55.354192 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-776ddff2-c7af-4344-a2dd-86bda3d50e11 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] HTTP exception thrown: Instance 993ac4a3-a4e1-43cb-b6da-af83833f1396 could not be found. Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-776ddff2-c7af-4344-a2dd-86bda3d50e11 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Request method failure captured: Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 HTTP/1.1 Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3QctcFZVl_N5jm8HoPIpzMuVmJf9GCR_sl2nmMIoA7dUv-5AJPFmq6Ykt1CJQIzejFBKzJT0j-M1HDsZpxhuhAbH7dSKBVxzZ2J_DTwushxvbKw1oPCgQcY7Uvi7ImOym1n5qFQfnnYcbgLZFqfN5x6AkD59fYIm62IoezlBrSXub4 Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 71b0e99f20e842c29ec46e5731ae9d9a Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-TestShelveInstance-110990130 Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:29:55.355910 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:29:55.357883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/71b0e99f20e842c29ec46e5731ae9d9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/71b0e99f20e842c29ec46e5731ae9d9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_71b0e99f20e842c29ec46e5731ae9d9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/71b0e99f20e842c29ec46e5731ae9d9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:29:55.357883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-TestShelveInstance-110990130 Sep 06 16:29:55.357883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 71b0e99f20e842c29ec46e5731ae9d9a Sep 06 16:29:55.357883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-TestShelveInstance-110990130 Sep 06 16:29:55.357883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-TestShelveInstance-110990130-project Sep 06 16:29:55.357883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:29:55.357883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:29:55.357883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: e8bab2b0d23a47e19c4a50e72fc75714 Sep 06 16:29:55.357883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-TestShelveInstance-110990130-project Sep 06 16:29:55.357883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:29:55.357883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance 993ac4a3-a4e1-43cb-b6da-af83833f1396 could not be found. Sep 06 16:29:55.357883 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': '993ac4a3-a4e1-43cb-b6da-af83833f1396'} Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993ac4a3-a4e1-43cb-b6da-af83833f1396 could not be found. Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:29:55.359142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993ac4a3-a4e1-43cb-b6da-af83833f1396 could not be found. Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993ac4a3-a4e1-43cb-b6da-af83833f1396 could not be found. Sep 06 16:29:55.360844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:29:55.362881 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-776ddff2-c7af-4344-a2dd-86bda3d50e11 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Returning 404 to user: Instance 993ac4a3-a4e1-43cb-b6da-af83833f1396 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:29:55.362881 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-776ddff2-c7af-4344-a2dd-86bda3d50e11 tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396" status: 404 len: 111 microversion: 2.1 time: 0.048847 Sep 06 16:29:55.363767 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 633/1289] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:29:55 2022] GET /compute/v2.1/servers/993ac4a3-a4e1-43cb-b6da-af83833f1396 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:29:55.617837 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-eaba9860-d725-4beb-8e40-ca73f34e63cf tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] Calling method '.version_select at 0x7f83e9567f70>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:55.639950 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-eaba9860-d725-4beb-8e40-ca73f34e63cf tempest-TestShelveInstance-110990130 tempest-TestShelveInstance-110990130-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-437123889" status: 202 len: 0 microversion: 2.1 time: 0.028577 Sep 06 16:29:55.640545 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 657/1290] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Sep 6 16:29:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-437123889 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:30:44.007167 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=54 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:44.007900 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c6f8dab7-5024-4d7b-87bf-83f6e964bbcd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:44.008280 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c6f8dab7-5024-4d7b-87bf-83f6e964bbcd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:44.008373 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:44.010727 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:44.011518 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:44.013093 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:30:44.013267 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Tue Sep 6 16:30:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 (ip 10.222.0.43) !!! Sep 06 16:30:44.013408 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-4d99b063-c55b-4b18-901b-5145e13190fe req-cc80706b-8553-4e0b-af39-ce23d3ca33c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a496a7-a09a-4130-b0be-b6f2be3883c5", "tag": "0f0cce3e-2c90-414d-8d7e-8cb96ae42718"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:44.022921 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c6f8dab7-5024-4d7b-87bf-83f6e964bbcd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:44.023787 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c6f8dab7-5024-4d7b-87bf-83f6e964bbcd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:44.023951 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c6f8dab7-5024-4d7b-87bf-83f6e964bbcd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:44.024654 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c6f8dab7-5024-4d7b-87bf-83f6e964bbcd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:44.025175 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c6f8dab7-5024-4d7b-87bf-83f6e964bbcd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:44.025319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-4d99b063-c55b-4b18-901b-5145e13190fe req-cc80706b-8553-4e0b-af39-ce23d3ca33c7 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:44.025583 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c6f8dab7-5024-4d7b-87bf-83f6e964bbcd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:44.025703 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-4d99b063-c55b-4b18-901b-5145e13190fe req-cc80706b-8553-4e0b-af39-ce23d3ca33c7 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:44.026137 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-4d99b063-c55b-4b18-901b-5145e13190fe req-cc80706b-8553-4e0b-af39-ce23d3ca33c7 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:44.039114 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-4d99b063-c55b-4b18-901b-5145e13190fe req-cc80706b-8553-4e0b-af39-ce23d3ca33c7 service nova] Creating event network-changed:0f0cce3e-2c90-414d-8d7e-8cb96ae42718 for instance 76a496a7-a09a-4130-b0be-b6f2be3883c5 on hv-cinder-85221 Sep 06 16:30:44.044569 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-4d99b063-c55b-4b18-901b-5145e13190fe req-cc80706b-8553-4e0b-af39-ce23d3ca33c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038989 Sep 06 16:30:44.045722 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 658/1291] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:30:44.055259 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c6f8dab7-5024-4d7b-87bf-83f6e964bbcd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Going to try to terminate instance {{(pid=120669) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:30:44.143525 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c6f8dab7-5024-4d7b-87bf-83f6e964bbcd tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "DELETE /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 204 len: 0 microversion: 2.1 time: 0.139321 Sep 06 16:30:44.144789 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 634/1292] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:30:44 2022] DELETE /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:30:44.154079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2e3ec62e-9182-4621-8822-d887a6ff0974 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:44.154785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2e3ec62e-9182-4621-8822-d887a6ff0974 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:44.163241 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e3ec62e-9182-4621-8822-d887a6ff0974 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:44.164123 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e3ec62e-9182-4621-8822-d887a6ff0974 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:44.164123 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e3ec62e-9182-4621-8822-d887a6ff0974 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:44.164894 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e3ec62e-9182-4621-8822-d887a6ff0974 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:44.165489 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e3ec62e-9182-4621-8822-d887a6ff0974 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:44.165743 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2e3ec62e-9182-4621-8822-d887a6ff0974 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:44.303010 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2e3ec62e-9182-4621-8822-d887a6ff0974 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:44.311206 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2e3ec62e-9182-4621-8822-d887a6ff0974 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1576 microversion: 2.1 time: 0.161760 Sep 06 16:30:44.311815 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 659/1293] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:44 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:45.334938 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-fed36a91-a892-4507-920e-823b8ab548a5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:45.335795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-fed36a91-a892-4507-920e-823b8ab548a5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:45.343475 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fed36a91-a892-4507-920e-823b8ab548a5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:45.343960 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fed36a91-a892-4507-920e-823b8ab548a5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:45.344398 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fed36a91-a892-4507-920e-823b8ab548a5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:45.345136 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fed36a91-a892-4507-920e-823b8ab548a5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:45.345590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fed36a91-a892-4507-920e-823b8ab548a5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:45.346028 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-fed36a91-a892-4507-920e-823b8ab548a5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:45.761485 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-fed36a91-a892-4507-920e-823b8ab548a5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:45.770031 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-fed36a91-a892-4507-920e-823b8ab548a5 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1576 microversion: 2.1 time: 0.439490 Sep 06 16:30:45.770614 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 635/1294] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:45 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1576 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:46.796798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1a54202e-5015-49da-b5ab-ac4c58a052b1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:46.796798 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1a54202e-5015-49da-b5ab-ac4c58a052b1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:46.803469 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1a54202e-5015-49da-b5ab-ac4c58a052b1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:46.803958 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1a54202e-5015-49da-b5ab-ac4c58a052b1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:46.804384 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1a54202e-5015-49da-b5ab-ac4c58a052b1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:46.805126 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1a54202e-5015-49da-b5ab-ac4c58a052b1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:46.805575 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1a54202e-5015-49da-b5ab-ac4c58a052b1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:46.806307 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1a54202e-5015-49da-b5ab-ac4c58a052b1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:46.881295 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1a54202e-5015-49da-b5ab-ac4c58a052b1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:46.882850 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-86a03e03-d645-44cf-9b7d-06389f097c25 req-01bb79cf-20ae-462d-b4c2-bb9aa0dc259e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a496a7-a09a-4130-b0be-b6f2be3883c5", "name": "network-vif-deleted", "tag": "0f0cce3e-2c90-414d-8d7e-8cb96ae42718"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:46.889984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1a54202e-5015-49da-b5ab-ac4c58a052b1 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 200 len: 1389 microversion: 2.1 time: 0.099948 Sep 06 16:30:46.890567 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 660/1295] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:46 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 1389 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:46.894432 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-86a03e03-d645-44cf-9b7d-06389f097c25 req-01bb79cf-20ae-462d-b4c2-bb9aa0dc259e service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:46.894913 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-86a03e03-d645-44cf-9b7d-06389f097c25 req-01bb79cf-20ae-462d-b4c2-bb9aa0dc259e service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:46.895351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-86a03e03-d645-44cf-9b7d-06389f097c25 req-01bb79cf-20ae-462d-b4c2-bb9aa0dc259e service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:46.907838 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-86a03e03-d645-44cf-9b7d-06389f097c25 req-01bb79cf-20ae-462d-b4c2-bb9aa0dc259e service nova] Creating event network-vif-deleted:0f0cce3e-2c90-414d-8d7e-8cb96ae42718 for instance 76a496a7-a09a-4130-b0be-b6f2be3883c5 on hv-cinder-85221 Sep 06 16:30:46.912944 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-86a03e03-d645-44cf-9b7d-06389f097c25 req-01bb79cf-20ae-462d-b4c2-bb9aa0dc259e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035257 Sep 06 16:30:46.913564 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 636/1296] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:30:47.914227 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c88bafb8-30ea-434b-9a97-4e655eee07dc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:47.914811 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c88bafb8-30ea-434b-9a97-4e655eee07dc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 76a496a7-a09a-4130-b0be-b6f2be3883c5] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:47.923648 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c88bafb8-30ea-434b-9a97-4e655eee07dc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:47.924143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c88bafb8-30ea-434b-9a97-4e655eee07dc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:47.924801 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c88bafb8-30ea-434b-9a97-4e655eee07dc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:47.925522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c88bafb8-30ea-434b-9a97-4e655eee07dc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:47.925950 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c88bafb8-30ea-434b-9a97-4e655eee07dc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:47.926369 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c88bafb8-30ea-434b-9a97-4e655eee07dc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:47.941271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-c88bafb8-30ea-434b-9a97-4e655eee07dc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] HTTP exception thrown: Instance 76a496a7-a09a-4130-b0be-b6f2be3883c5 could not be found. Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c88bafb8-30ea-434b-9a97-4e655eee07dc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Request method failure captured: Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 HTTP/1.1 Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3OiREQhTG9B-Q5aJkgP_rWhBDmzhNdyLx85uYcI2ePpI7dxK2qnue3q-QjISF-nlPJ_d8kmIRxLHMIbMKZsWH6UVwgIAGqR0bY5zS2cwoHKxroF1RVviH1F8KmDGnug0G94yeQRTcLzdRp8JocDNPG4asAAfN2TUUI68gRXtv1Tcqs Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: f90ec559752b44b2b67c765488814865 Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:30:47.942930 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:30:47.944952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f90ec559752b44b2b67c765488814865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f90ec559752b44b2b67c765488814865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f90ec559752b44b2b67c765488814865"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f90ec559752b44b2b67c765488814865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:30:47.944952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:30:47.944952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: f90ec559752b44b2b67c765488814865 Sep 06 16:30:47.944952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:30:47.944952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-TestVolumeBootPattern-1496949111-project Sep 06 16:30:47.944952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:30:47.944952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:30:47.944952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 4d3856b7bb7f4f5bb801952b893bbe35 Sep 06 16:30:47.944952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-TestVolumeBootPattern-1496949111-project Sep 06 16:30:47.944952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:30:47.944952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance 76a496a7-a09a-4130-b0be-b6f2be3883c5 could not be found. Sep 06 16:30:47.944952 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': '76a496a7-a09a-4130-b0be-b6f2be3883c5'} Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a496a7-a09a-4130-b0be-b6f2be3883c5 could not be found. Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:30:47.945963 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a496a7-a09a-4130-b0be-b6f2be3883c5 could not be found. Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a496a7-a09a-4130-b0be-b6f2be3883c5 could not be found. Sep 06 16:30:47.947876 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:47.949454 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c88bafb8-30ea-434b-9a97-4e655eee07dc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Returning 404 to user: Instance 76a496a7-a09a-4130-b0be-b6f2be3883c5 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:30:47.949454 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c88bafb8-30ea-434b-9a97-4e655eee07dc tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5" status: 404 len: 111 microversion: 2.1 time: 0.036304 Sep 06 16:30:47.949454 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 661/1297] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:47 2022] GET /compute/v2.1/servers/76a496a7-a09a-4130-b0be-b6f2be3883c5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:30:51.026799 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a24f7293-7f77-4398-a483-f975d8e34eaa tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:51.027355 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a24f7293-7f77-4398-a483-f975d8e34eaa tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:51.033991 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-5e19503c-50da-45a0-8fd6-f360389d01b4 req-a9f95add-337b-43d6-b275-8a4de7aa6acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9288c862-6167-4869-98a5-8121505ea169", "tag": "791df2dc-93bb-4c44-8f32-337aa6fcd193"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:51.044743 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-5e19503c-50da-45a0-8fd6-f360389d01b4 req-a9f95add-337b-43d6-b275-8a4de7aa6acb service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:51.045000 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a24f7293-7f77-4398-a483-f975d8e34eaa tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:51.045341 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a24f7293-7f77-4398-a483-f975d8e34eaa tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:51.045776 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a24f7293-7f77-4398-a483-f975d8e34eaa tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:51.045922 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-5e19503c-50da-45a0-8fd6-f360389d01b4 req-a9f95add-337b-43d6-b275-8a4de7aa6acb service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:51.046215 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-5e19503c-50da-45a0-8fd6-f360389d01b4 req-a9f95add-337b-43d6-b275-8a4de7aa6acb service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:51.046840 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a24f7293-7f77-4398-a483-f975d8e34eaa tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:51.047293 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a24f7293-7f77-4398-a483-f975d8e34eaa tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:51.047711 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a24f7293-7f77-4398-a483-f975d8e34eaa tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:51.058895 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-5e19503c-50da-45a0-8fd6-f360389d01b4 req-a9f95add-337b-43d6-b275-8a4de7aa6acb service nova] Creating event network-changed:791df2dc-93bb-4c44-8f32-337aa6fcd193 for instance 9288c862-6167-4869-98a5-8121505ea169 on hv-cinder-85221 Sep 06 16:30:51.064158 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-5e19503c-50da-45a0-8fd6-f360389d01b4 req-a9f95add-337b-43d6-b275-8a4de7aa6acb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034100 Sep 06 16:30:51.064776 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 662/1298] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:30:51.074644 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a24f7293-7f77-4398-a483-f975d8e34eaa tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Going to try to terminate instance {{(pid=120669) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:30:51.163728 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a24f7293-7f77-4398-a483-f975d8e34eaa tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 204 len: 0 microversion: 2.1 time: 0.141431 Sep 06 16:30:51.164587 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 637/1299] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:30:51 2022] DELETE /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:30:51.175224 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2579d1ad-0106-4fbd-a42f-e7f36549d18a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:51.176021 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2579d1ad-0106-4fbd-a42f-e7f36549d18a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:51.183526 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2579d1ad-0106-4fbd-a42f-e7f36549d18a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:51.184008 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2579d1ad-0106-4fbd-a42f-e7f36549d18a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:51.184434 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2579d1ad-0106-4fbd-a42f-e7f36549d18a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:51.185169 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2579d1ad-0106-4fbd-a42f-e7f36549d18a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:51.185615 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2579d1ad-0106-4fbd-a42f-e7f36549d18a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:51.186029 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2579d1ad-0106-4fbd-a42f-e7f36549d18a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:51.386544 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2579d1ad-0106-4fbd-a42f-e7f36549d18a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:51.395338 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2579d1ad-0106-4fbd-a42f-e7f36549d18a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1578 microversion: 2.1 time: 0.225224 Sep 06 16:30:51.396581 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 663/1300] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:51 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1578 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:52.420392 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1d52bb28-b5e6-42fa-80c5-a701cad45608 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:52.421209 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1d52bb28-b5e6-42fa-80c5-a701cad45608 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:52.428865 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d52bb28-b5e6-42fa-80c5-a701cad45608 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:52.429362 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d52bb28-b5e6-42fa-80c5-a701cad45608 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:52.429792 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d52bb28-b5e6-42fa-80c5-a701cad45608 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:52.430494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d52bb28-b5e6-42fa-80c5-a701cad45608 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:52.430937 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d52bb28-b5e6-42fa-80c5-a701cad45608 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:52.431429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1d52bb28-b5e6-42fa-80c5-a701cad45608 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:52.635695 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-1d52bb28-b5e6-42fa-80c5-a701cad45608 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:52.644019 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1d52bb28-b5e6-42fa-80c5-a701cad45608 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1460 microversion: 2.1 time: 0.227858 Sep 06 16:30:52.644547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 638/1301] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:52 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1460 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:53.080896 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-7a8ed99c-1a2e-4a5a-b190-cedb75fdd788 req-f92f5d07-4faf-4537-8d32-abe4602875fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9288c862-6167-4869-98a5-8121505ea169", "name": "network-vif-deleted", "tag": "791df2dc-93bb-4c44-8f32-337aa6fcd193"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:53.093188 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-7a8ed99c-1a2e-4a5a-b190-cedb75fdd788 req-f92f5d07-4faf-4537-8d32-abe4602875fc service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:53.093809 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-7a8ed99c-1a2e-4a5a-b190-cedb75fdd788 req-f92f5d07-4faf-4537-8d32-abe4602875fc service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:53.094337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-7a8ed99c-1a2e-4a5a-b190-cedb75fdd788 req-f92f5d07-4faf-4537-8d32-abe4602875fc service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:53.107687 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-7a8ed99c-1a2e-4a5a-b190-cedb75fdd788 req-f92f5d07-4faf-4537-8d32-abe4602875fc service nova] Creating event network-vif-deleted:791df2dc-93bb-4c44-8f32-337aa6fcd193 for instance 9288c862-6167-4869-98a5-8121505ea169 on hv-cinder-85221 Sep 06 16:30:53.113291 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-7a8ed99c-1a2e-4a5a-b190-cedb75fdd788 req-f92f5d07-4faf-4537-8d32-abe4602875fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036304 Sep 06 16:30:53.114148 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 664/1302] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:30:53.668407 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:53.669035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:53.676092 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:53.676564 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:53.677018 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:53.677745 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:53.678190 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:53.678759 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:53.712947 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:53.713427 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:53.713988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:53.714371 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lazy-loading 'fault' on Instance uuid 9288c862-6167-4869-98a5-8121505ea169 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:30:53.766042 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3856b7bb7f4f5bb801952b893bbe35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90ec559752b44b2b67c765488814865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:53.775127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a7fd5a2e-1929-4115-84c2-d3ae3a232446 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 200 len: 1184 microversion: 2.1 time: 0.111331 Sep 06 16:30:53.776033 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 639/1303] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:53 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 1184 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:54.801207 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-bd64d220-0acf-4102-b8b2-82ad3e8ce8e3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:54.801964 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-bd64d220-0acf-4102-b8b2-82ad3e8ce8e3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 9288c862-6167-4869-98a5-8121505ea169] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:54.808696 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd64d220-0acf-4102-b8b2-82ad3e8ce8e3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:54.809222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd64d220-0acf-4102-b8b2-82ad3e8ce8e3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:54.809671 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd64d220-0acf-4102-b8b2-82ad3e8ce8e3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:54.810364 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd64d220-0acf-4102-b8b2-82ad3e8ce8e3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:54.810816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd64d220-0acf-4102-b8b2-82ad3e8ce8e3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:54.811239 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-bd64d220-0acf-4102-b8b2-82ad3e8ce8e3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:54.827194 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-bd64d220-0acf-4102-b8b2-82ad3e8ce8e3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] HTTP exception thrown: Instance 9288c862-6167-4869-98a5-8121505ea169 could not be found. Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-bd64d220-0acf-4102-b8b2-82ad3e8ce8e3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Request method failure captured: Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 HTTP/1.1 Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3OiREQhTG9B-Q5aJkgP_rWhBDmzhNdyLx85uYcI2ePpI7dxK2qnue3q-QjISF-nlPJ_d8kmIRxLHMIbMKZsWH6UVwgIAGqR0bY5zS2cwoHKxroF1RVviH1F8KmDGnug0G94yeQRTcLzdRp8JocDNPG4asAAfN2TUUI68gRXtv1Tcqs Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: f90ec559752b44b2b67c765488814865 Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:30:54.832094 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:30:54.834721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f90ec559752b44b2b67c765488814865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f90ec559752b44b2b67c765488814865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f90ec559752b44b2b67c765488814865"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f90ec559752b44b2b67c765488814865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:30:54.834721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:30:54.834721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: f90ec559752b44b2b67c765488814865 Sep 06 16:30:54.834721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:30:54.834721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-TestVolumeBootPattern-1496949111-project Sep 06 16:30:54.834721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:30:54.834721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:30:54.834721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 4d3856b7bb7f4f5bb801952b893bbe35 Sep 06 16:30:54.834721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-TestVolumeBootPattern-1496949111-project Sep 06 16:30:54.834721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:30:54.834721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance 9288c862-6167-4869-98a5-8121505ea169 could not be found. Sep 06 16:30:54.834721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': '9288c862-6167-4869-98a5-8121505ea169'} Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9288c862-6167-4869-98a5-8121505ea169 could not be found. Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:30:54.836238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9288c862-6167-4869-98a5-8121505ea169 could not be found. Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9288c862-6167-4869-98a5-8121505ea169 could not be found. Sep 06 16:30:54.839000 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:54.840542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-bd64d220-0acf-4102-b8b2-82ad3e8ce8e3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Returning 404 to user: Instance 9288c862-6167-4869-98a5-8121505ea169 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:30:54.840542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-bd64d220-0acf-4102-b8b2-82ad3e8ce8e3 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169" status: 404 len: 111 microversion: 2.1 time: 0.039414 Sep 06 16:30:54.840542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 665/1304] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:54 2022] GET /compute/v2.1/servers/9288c862-6167-4869-98a5-8121505ea169 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:30:55.565343 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-517026d6-5849-4206-ac79-9c2ff6a3f95a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:55.565912 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-517026d6-5849-4206-ac79-9c2ff6a3f95a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:55.573107 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-517026d6-5849-4206-ac79-9c2ff6a3f95a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:55.573587 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-517026d6-5849-4206-ac79-9c2ff6a3f95a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:55.574049 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-517026d6-5849-4206-ac79-9c2ff6a3f95a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:55.574738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-517026d6-5849-4206-ac79-9c2ff6a3f95a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:55.575282 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-517026d6-5849-4206-ac79-9c2ff6a3f95a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:55.575604 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-517026d6-5849-4206-ac79-9c2ff6a3f95a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:55.590156 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-517026d6-5849-4206-ac79-9c2ff6a3f95a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] HTTP exception thrown: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-517026d6-5849-4206-ac79-9c2ff6a3f95a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Request method failure captured: Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: DELETE /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a HTTP/1.1 Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3OiREQhTG9B-Q5aJkgP_rWhBDmzhNdyLx85uYcI2ePpI7dxK2qnue3q-QjISF-nlPJ_d8kmIRxLHMIbMKZsWH6UVwgIAGqR0bY5zS2cwoHKxroF1RVviH1F8KmDGnug0G94yeQRTcLzdRp8JocDNPG4asAAfN2TUUI68gRXtv1Tcqs Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: f90ec559752b44b2b67c765488814865 Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:30:55.591955 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:30:55.593818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f90ec559752b44b2b67c765488814865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f90ec559752b44b2b67c765488814865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f90ec559752b44b2b67c765488814865"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f90ec559752b44b2b67c765488814865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:30:55.593818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:30:55.593818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: f90ec559752b44b2b67c765488814865 Sep 06 16:30:55.593818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:30:55.593818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-TestVolumeBootPattern-1496949111-project Sep 06 16:30:55.593818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:30:55.593818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:30:55.593818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 4d3856b7bb7f4f5bb801952b893bbe35 Sep 06 16:30:55.593818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-TestVolumeBootPattern-1496949111-project Sep 06 16:30:55.593818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:30:55.593818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:30:55.593818 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': '0542e187-d122-46db-bece-5aa1b888806a'} Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:30:55.594738 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:30:55.596102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:30:55.597924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-517026d6-5849-4206-ac79-9c2ff6a3f95a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Returning 404 to user: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:30:55.597924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-517026d6-5849-4206-ac79-9c2ff6a3f95a tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 404 len: 111 microversion: 2.1 time: 0.032013 Sep 06 16:30:55.597924 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 640/1305] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:30:55 2022] DELETE /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:30:55.603486 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b31fa629-18fe-4618-8a3d-f170c24dbe60 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:55.604128 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b31fa629-18fe-4618-8a3d-f170c24dbe60 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] [instance: 0542e187-d122-46db-bece-5aa1b888806a] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:55.610909 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b31fa629-18fe-4618-8a3d-f170c24dbe60 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:55.611435 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b31fa629-18fe-4618-8a3d-f170c24dbe60 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:55.611872 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b31fa629-18fe-4618-8a3d-f170c24dbe60 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:55.612576 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b31fa629-18fe-4618-8a3d-f170c24dbe60 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:55.613126 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b31fa629-18fe-4618-8a3d-f170c24dbe60 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:55.613553 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b31fa629-18fe-4618-8a3d-f170c24dbe60 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:55.630556 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-b31fa629-18fe-4618-8a3d-f170c24dbe60 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] HTTP exception thrown: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b31fa629-18fe-4618-8a3d-f170c24dbe60 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Request method failure captured: Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a HTTP/1.1 Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3OiREQhTG9B-Q5aJkgP_rWhBDmzhNdyLx85uYcI2ePpI7dxK2qnue3q-QjISF-nlPJ_d8kmIRxLHMIbMKZsWH6UVwgIAGqR0bY5zS2cwoHKxroF1RVviH1F8KmDGnug0G94yeQRTcLzdRp8JocDNPG4asAAfN2TUUI68gRXtv1Tcqs Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: f90ec559752b44b2b67c765488814865 Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:30:55.632233 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:30:55.633984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f90ec559752b44b2b67c765488814865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f90ec559752b44b2b67c765488814865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f90ec559752b44b2b67c765488814865"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f90ec559752b44b2b67c765488814865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:30:55.633984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:30:55.633984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: f90ec559752b44b2b67c765488814865 Sep 06 16:30:55.633984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-TestVolumeBootPattern-1496949111 Sep 06 16:30:55.633984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-TestVolumeBootPattern-1496949111-project Sep 06 16:30:55.633984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:30:55.633984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:30:55.633984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 4d3856b7bb7f4f5bb801952b893bbe35 Sep 06 16:30:55.633984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-TestVolumeBootPattern-1496949111-project Sep 06 16:30:55.633984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:30:55.633984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:30:55.633984 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': '0542e187-d122-46db-bece-5aa1b888806a'} Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:30:55.635323 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. Sep 06 16:30:55.637627 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:30:55.639800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b31fa629-18fe-4618-8a3d-f170c24dbe60 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Returning 404 to user: Instance 0542e187-d122-46db-bece-5aa1b888806a could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:30:55.639800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b31fa629-18fe-4618-8a3d-f170c24dbe60 tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a" status: 404 len: 111 microversion: 2.1 time: 0.034273 Sep 06 16:30:55.639800 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 666/1306] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:55 2022] GET /compute/v2.1/servers/0542e187-d122-46db-bece-5aa1b888806a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:30:56.975461 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c698e148-04db-4607-9cf0-64b2161aee7c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] Calling method '.version_select at 0x7f83eccd69d0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:57.010370 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c698e148-04db-4607-9cf0-64b2161aee7c tempest-TestVolumeBootPattern-1496949111 tempest-TestVolumeBootPattern-1496949111-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-923325397" status: 202 len: 0 microversion: 2.1 time: 0.038905 Sep 06 16:30:57.010970 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 641/1307] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Sep 6 16:30:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-923325397 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:31:21.951162 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-50c641dd-82bf-4ba0-95ba-29ebb39e886f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:21.951812 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-50c641dd-82bf-4ba0-95ba-29ebb39e886f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:21.953853 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=18 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:31:21.954498 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=30 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:31:21.955625 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:31:21.955806 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Tue Sep 6 16:31:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350/ips (ip 10.222.0.43) !!! Sep 06 16:31:21.968351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-50c641dd-82bf-4ba0-95ba-29ebb39e886f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:21.968863 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-50c641dd-82bf-4ba0-95ba-29ebb39e886f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:21.969280 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-50c641dd-82bf-4ba0-95ba-29ebb39e886f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:21.969972 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-50c641dd-82bf-4ba0-95ba-29ebb39e886f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:21.970420 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-50c641dd-82bf-4ba0-95ba-29ebb39e886f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:21.970829 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-50c641dd-82bf-4ba0-95ba-29ebb39e886f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:21.995813 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-50c641dd-82bf-4ba0-95ba-29ebb39e886f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350/ips" status: 200 len: 149 microversion: 2.1 time: 0.048643 Sep 06 16:31:21.996389 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 667/1308] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 6 16:31:21 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:31:22.008573 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c9d179a2-9e72-41bc-a9c9-2a0a5aa37cb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b67816f-d280-4726-962e-514e85b98946"}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:31:22.010920 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c9d179a2-9e72-41bc-a9c9-2a0a5aa37cb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:22.014196 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:31:22.014827 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:31:22.021190 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9d179a2-9e72-41bc-a9c9-2a0a5aa37cb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:22.021733 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9d179a2-9e72-41bc-a9c9-2a0a5aa37cb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:22.022142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9d179a2-9e72-41bc-a9c9-2a0a5aa37cb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:22.022849 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9d179a2-9e72-41bc-a9c9-2a0a5aa37cb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:22.023299 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9d179a2-9e72-41bc-a9c9-2a0a5aa37cb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:22.023720 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c9d179a2-9e72-41bc-a9c9-2a0a5aa37cb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:22.112147 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-c9d179a2-9e72-41bc-a9c9-2a0a5aa37cb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Invalid volume: volume 5b67816f-d280-4726-962e-514e85b98946 is already attached to instances: e7d7393f-d0b9-480d-bfe7-36439a86c064 Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c9d179a2-9e72-41bc-a9c9-2a0a5aa37cb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: POST /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350/os-volume_attachments HTTP/1.1 Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 74 Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:31:22.114534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:31:22.117130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:31:22.117130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:31:22.117130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:31:22.117130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:31:22.117130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:31:22.117130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:31:22.117130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:31:22.117130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:31:22.117130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:31:22.117130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Sep 06 16:31:22.117130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {"volumeAttachment": {"volumeId": "5b67816f-d280-4726-962e-514e85b98946"}} Sep 06 16:31:22.117130 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Invalid volume: volume 5b67816f-d280-4726-962e-514e85b98946 is already attached to instances: e7d7393f-d0b9-480d-bfe7-36439a86c064 Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'server_id': 'a2a83e1d-7bb7-4e42-8a31-530ded48a350', 'body': {'volumeAttachment': {'volumeId': '5b67816f-d280-4726-962e-514e85b98946'}}} Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5b67816f-d280-4726-962e-514e85b98946 is already attached to instances: e7d7393f-d0b9-480d-bfe7-36439a86c064 Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:31:22.118187 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5b67816f-d280-4726-962e-514e85b98946 is already attached to instances: e7d7393f-d0b9-480d-bfe7-36439a86c064 Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:31:22.119820 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:31:22.121965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:31:22.121965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:31:22.121965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:31:22.121965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5b67816f-d280-4726-962e-514e85b98946 is already attached to instances: e7d7393f-d0b9-480d-bfe7-36439a86c064 Sep 06 16:31:22.121965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:31:22.121965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c9d179a2-9e72-41bc-a9c9-2a0a5aa37cb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 400 to user: Invalid volume: volume 5b67816f-d280-4726-962e-514e85b98946 is already attached to instances: e7d7393f-d0b9-480d-bfe7-36439a86c064 {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:31:22.121965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c9d179a2-9e72-41bc-a9c9-2a0a5aa37cb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111921 Sep 06 16:31:22.121965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 642/1309] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:31:22 2022] POST /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:31:22.130352 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b693ecd3-97c6-4f12-8472-3257a53f7dd6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:22.130893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b693ecd3-97c6-4f12-8472-3257a53f7dd6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:22.137819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b693ecd3-97c6-4f12-8472-3257a53f7dd6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:22.138316 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b693ecd3-97c6-4f12-8472-3257a53f7dd6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:22.138746 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b693ecd3-97c6-4f12-8472-3257a53f7dd6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:22.139444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b693ecd3-97c6-4f12-8472-3257a53f7dd6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:22.139919 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b693ecd3-97c6-4f12-8472-3257a53f7dd6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:22.140341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b693ecd3-97c6-4f12-8472-3257a53f7dd6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:22.168804 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b693ecd3-97c6-4f12-8472-3257a53f7dd6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Going to try to terminate instance {{(pid=120668) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:31:22.265396 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b693ecd3-97c6-4f12-8472-3257a53f7dd6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 204 len: 0 microversion: 2.1 time: 0.141650 Sep 06 16:31:22.266096 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 668/1310] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:31:22 2022] DELETE /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:31:22.275138 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-2a93902e-2e56-4f0b-bc9f-b69a608ba25b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:22.275779 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-2a93902e-2e56-4f0b-bc9f-b69a608ba25b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:22.287526 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2a93902e-2e56-4f0b-bc9f-b69a608ba25b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:22.288295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2a93902e-2e56-4f0b-bc9f-b69a608ba25b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:22.288838 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2a93902e-2e56-4f0b-bc9f-b69a608ba25b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:22.289989 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2a93902e-2e56-4f0b-bc9f-b69a608ba25b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:22.290613 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2a93902e-2e56-4f0b-bc9f-b69a608ba25b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:22.291085 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2a93902e-2e56-4f0b-bc9f-b69a608ba25b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:22.445169 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-2a93902e-2e56-4f0b-bc9f-b69a608ba25b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:22.455605 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-2a93902e-2e56-4f0b-bc9f-b69a608ba25b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1680 microversion: 2.1 time: 0.184813 Sep 06 16:31:22.456210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 643/1311] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:22 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:23.481435 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e04ec8a0-7c24-47f7-a373-a2962460796d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:23.482189 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-e04ec8a0-7c24-47f7-a373-a2962460796d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:23.490075 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e04ec8a0-7c24-47f7-a373-a2962460796d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:23.490572 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e04ec8a0-7c24-47f7-a373-a2962460796d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:23.491006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e04ec8a0-7c24-47f7-a373-a2962460796d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:23.491713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e04ec8a0-7c24-47f7-a373-a2962460796d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:23.492257 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e04ec8a0-7c24-47f7-a373-a2962460796d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:23.492808 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-e04ec8a0-7c24-47f7-a373-a2962460796d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:23.640569 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-e04ec8a0-7c24-47f7-a373-a2962460796d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:23.648868 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e04ec8a0-7c24-47f7-a373-a2962460796d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1680 microversion: 2.1 time: 0.171860 Sep 06 16:31:23.649538 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 669/1312] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:23 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:24.672884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8b1a5ca1-377a-4c13-a611-cf50fd8ae776 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:24.673875 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8b1a5ca1-377a-4c13-a611-cf50fd8ae776 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:24.682253 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8b1a5ca1-377a-4c13-a611-cf50fd8ae776 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:24.682806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8b1a5ca1-377a-4c13-a611-cf50fd8ae776 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:24.684429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8b1a5ca1-377a-4c13-a611-cf50fd8ae776 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:24.684429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8b1a5ca1-377a-4c13-a611-cf50fd8ae776 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:24.684429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8b1a5ca1-377a-4c13-a611-cf50fd8ae776 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:24.684880 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8b1a5ca1-377a-4c13-a611-cf50fd8ae776 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:24.790935 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-8b1a5ca1-377a-4c13-a611-cf50fd8ae776 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:24.799517 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8b1a5ca1-377a-4c13-a611-cf50fd8ae776 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 200 len: 1613 microversion: 2.1 time: 0.131506 Sep 06 16:31:24.800112 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 644/1313] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:24 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 1613 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:31:25.044412 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-bbedafac-7666-4589-8f87-a3eccfcc27cb req-63e40d3c-fda8-4c96-8b8e-36ac22190461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a83e1d-7bb7-4e42-8a31-530ded48a350", "name": "network-vif-deleted", "tag": "6f30db3a-4d6c-4aa0-a564-c22b0d45dd9b"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:31:25.062321 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-bbedafac-7666-4589-8f87-a3eccfcc27cb req-63e40d3c-fda8-4c96-8b8e-36ac22190461 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:25.062321 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-bbedafac-7666-4589-8f87-a3eccfcc27cb req-63e40d3c-fda8-4c96-8b8e-36ac22190461 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:25.062321 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-bbedafac-7666-4589-8f87-a3eccfcc27cb req-63e40d3c-fda8-4c96-8b8e-36ac22190461 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:25.074595 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-bbedafac-7666-4589-8f87-a3eccfcc27cb req-63e40d3c-fda8-4c96-8b8e-36ac22190461 service nova] Creating event network-vif-deleted:6f30db3a-4d6c-4aa0-a564-c22b0d45dd9b for instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 on hv-cinder-85221 Sep 06 16:31:25.083600 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-bbedafac-7666-4589-8f87-a3eccfcc27cb req-63e40d3c-fda8-4c96-8b8e-36ac22190461 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048611 Sep 06 16:31:25.084238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 670/1314] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:31:25.824938 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6da6c329-fede-4e37-a447-ea4433935647 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:25.825971 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6da6c329-fede-4e37-a447-ea4433935647 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:25.833714 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6da6c329-fede-4e37-a447-ea4433935647 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:25.834388 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6da6c329-fede-4e37-a447-ea4433935647 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:25.834774 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6da6c329-fede-4e37-a447-ea4433935647 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:25.835505 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6da6c329-fede-4e37-a447-ea4433935647 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:25.835931 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6da6c329-fede-4e37-a447-ea4433935647 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:25.836508 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6da6c329-fede-4e37-a447-ea4433935647 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:25.850845 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-6da6c329-fede-4e37-a447-ea4433935647 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6da6c329-fede-4e37-a447-ea4433935647 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 HTTP/1.1 Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:31:25.852559 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:31:25.854515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:31:25.854515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:31:25.854515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:31:25.854515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:31:25.854515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:31:25.854515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:31:25.854515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:31:25.854515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:31:25.854515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:31:25.854515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:31:25.854515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:31:25.854515 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'a2a83e1d-7bb7-4e42-8a31-530ded48a350'} Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:31:25.855724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:31:25.857769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:31:25.859332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6da6c329-fede-4e37-a447-ea4433935647 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 404 to user: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:31:25.859332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6da6c329-fede-4e37-a447-ea4433935647 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 404 len: 111 microversion: 2.1 time: 0.033542 Sep 06 16:31:25.859332 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 645/1315] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:25 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:31:25.863768 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-eac0ca21-0f4f-4703-9fc4-a6df7de8b62f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '.version_select at 0x7f83e9452af0>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:25.897442 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-eac0ca21-0f4f-4703-9fc4-a6df7de8b62f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-418181524" status: 202 len: 0 microversion: 2.1 time: 0.037576 Sep 06 16:31:25.898087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 671/1316] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Sep 6 16:31:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-418181524 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 16:31:26.641844 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-8e3af16c-080f-4cbb-b017-5f8663adafab tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:26.642428 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-8e3af16c-080f-4cbb-b017-5f8663adafab tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:26.648976 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e3af16c-080f-4cbb-b017-5f8663adafab tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:26.649456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e3af16c-080f-4cbb-b017-5f8663adafab tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:26.649947 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e3af16c-080f-4cbb-b017-5f8663adafab tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:26.650641 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e3af16c-080f-4cbb-b017-5f8663adafab tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:26.651084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e3af16c-080f-4cbb-b017-5f8663adafab tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:26.651568 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-8e3af16c-080f-4cbb-b017-5f8663adafab tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:26.747795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-8e3af16c-080f-4cbb-b017-5f8663adafab tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lazy-loading 'services' on Instance uuid e7d7393f-d0b9-480d-bfe7-36439a86c064 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:31:26.833721 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-8e3af16c-080f-4cbb-b017-5f8663adafab tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064/os-volume_attachments/5b67816f-d280-4726-962e-514e85b98946" status: 202 len: 0 microversion: 2.1 time: 0.195257 Sep 06 16:31:26.833721 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 646/1317] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 6 16:31:26 2022] DELETE /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064/os-volume_attachments/5b67816f-d280-4726-962e-514e85b98946 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:31:26.843516 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-3705e217-2da4-443a-848c-fa98139fd643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:26.846096 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-3705e217-2da4-443a-848c-fa98139fd643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:26.856223 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3705e217-2da4-443a-848c-fa98139fd643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:26.856653 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3705e217-2da4-443a-848c-fa98139fd643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:26.857107 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3705e217-2da4-443a-848c-fa98139fd643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:26.857806 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3705e217-2da4-443a-848c-fa98139fd643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:26.858282 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3705e217-2da4-443a-848c-fa98139fd643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:26.858701 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-3705e217-2da4-443a-848c-fa98139fd643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:26.892515 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-3705e217-2da4-443a-848c-fa98139fd643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053833 Sep 06 16:31:26.893193 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 672/1318] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:31:26 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:31:27.908131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e24d7862-87a0-464a-9b1e-9f43ad59bee4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:27.910827 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e24d7862-87a0-464a-9b1e-9f43ad59bee4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:27.919709 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e24d7862-87a0-464a-9b1e-9f43ad59bee4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:27.920219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e24d7862-87a0-464a-9b1e-9f43ad59bee4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:27.921018 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e24d7862-87a0-464a-9b1e-9f43ad59bee4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:27.921799 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e24d7862-87a0-464a-9b1e-9f43ad59bee4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:27.922251 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e24d7862-87a0-464a-9b1e-9f43ad59bee4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:27.922668 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e24d7862-87a0-464a-9b1e-9f43ad59bee4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:27.955778 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e24d7862-87a0-464a-9b1e-9f43ad59bee4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053087 Sep 06 16:31:27.956344 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 647/1319] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:31:27 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:31:28.022904 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-894b0607-fb39-46c2-a62d-1c460e457308 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:28.023528 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-894b0607-fb39-46c2-a62d-1c460e457308 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:28.029983 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-894b0607-fb39-46c2-a62d-1c460e457308 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:28.030465 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-894b0607-fb39-46c2-a62d-1c460e457308 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:28.030894 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-894b0607-fb39-46c2-a62d-1c460e457308 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:28.031582 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-894b0607-fb39-46c2-a62d-1c460e457308 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:28.032034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-894b0607-fb39-46c2-a62d-1c460e457308 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:28.032449 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-894b0607-fb39-46c2-a62d-1c460e457308 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:28.060911 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-894b0607-fb39-46c2-a62d-1c460e457308 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Going to try to terminate instance {{(pid=120668) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:31:28.150903 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-894b0607-fb39-46c2-a62d-1c460e457308 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 204 len: 0 microversion: 2.1 time: 0.131116 Sep 06 16:31:28.152051 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 673/1320] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:31:28 2022] DELETE /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:31:28.160328 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cdf46f0d-11ba-41e4-9ff6-fdf7cb845d7f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:28.161044 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cdf46f0d-11ba-41e4-9ff6-fdf7cb845d7f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:28.167753 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cdf46f0d-11ba-41e4-9ff6-fdf7cb845d7f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:28.168263 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cdf46f0d-11ba-41e4-9ff6-fdf7cb845d7f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:28.168740 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cdf46f0d-11ba-41e4-9ff6-fdf7cb845d7f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:28.169456 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cdf46f0d-11ba-41e4-9ff6-fdf7cb845d7f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:28.169912 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cdf46f0d-11ba-41e4-9ff6-fdf7cb845d7f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:28.170339 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cdf46f0d-11ba-41e4-9ff6-fdf7cb845d7f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:28.320812 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cdf46f0d-11ba-41e4-9ff6-fdf7cb845d7f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:28.329004 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cdf46f0d-11ba-41e4-9ff6-fdf7cb845d7f tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1682 microversion: 2.1 time: 0.172570 Sep 06 16:31:28.329582 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 648/1321] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:28 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:29.355883 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-0db7904d-d604-41d0-9632-8e86e99a1ca0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:29.356588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-0db7904d-d604-41d0-9632-8e86e99a1ca0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:29.363554 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0db7904d-d604-41d0-9632-8e86e99a1ca0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:29.364010 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0db7904d-d604-41d0-9632-8e86e99a1ca0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:29.364435 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0db7904d-d604-41d0-9632-8e86e99a1ca0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:29.365180 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0db7904d-d604-41d0-9632-8e86e99a1ca0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:29.365632 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0db7904d-d604-41d0-9632-8e86e99a1ca0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:29.366048 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-0db7904d-d604-41d0-9632-8e86e99a1ca0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:29.513548 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-0db7904d-d604-41d0-9632-8e86e99a1ca0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:29.523841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-0db7904d-d604-41d0-9632-8e86e99a1ca0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1682 microversion: 2.1 time: 0.172028 Sep 06 16:31:29.524634 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 674/1322] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:29 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:30.548736 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-24b16d2c-c93b-4647-bbc3-28b1aaf96d91 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:30.549369 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-24b16d2c-c93b-4647-bbc3-28b1aaf96d91 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:30.556532 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24b16d2c-c93b-4647-bbc3-28b1aaf96d91 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:30.557041 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24b16d2c-c93b-4647-bbc3-28b1aaf96d91 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:30.557565 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24b16d2c-c93b-4647-bbc3-28b1aaf96d91 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:30.558336 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24b16d2c-c93b-4647-bbc3-28b1aaf96d91 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:30.558755 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24b16d2c-c93b-4647-bbc3-28b1aaf96d91 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:30.559181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-24b16d2c-c93b-4647-bbc3-28b1aaf96d91 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:30.847584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-24b16d2c-c93b-4647-bbc3-28b1aaf96d91 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:30.857502 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-24b16d2c-c93b-4647-bbc3-28b1aaf96d91 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1682 microversion: 2.1 time: 0.313076 Sep 06 16:31:30.858210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 649/1323] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:30 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1682 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:31.504951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-f440727e-efb1-41cf-80d6-78f0a11ddef1 req-2bb225c0-5aba-4043-8ac3-8483e75cbf78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d7393f-d0b9-480d-bfe7-36439a86c064", "name": "network-vif-deleted", "tag": "b3676286-2353-4328-82d5-f123f7bfbd1d"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:31:31.517153 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-f440727e-efb1-41cf-80d6-78f0a11ddef1 req-2bb225c0-5aba-4043-8ac3-8483e75cbf78 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:31.517712 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-f440727e-efb1-41cf-80d6-78f0a11ddef1 req-2bb225c0-5aba-4043-8ac3-8483e75cbf78 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:31.518733 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-f440727e-efb1-41cf-80d6-78f0a11ddef1 req-2bb225c0-5aba-4043-8ac3-8483e75cbf78 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:31.532212 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-f440727e-efb1-41cf-80d6-78f0a11ddef1 req-2bb225c0-5aba-4043-8ac3-8483e75cbf78 service nova] Creating event network-vif-deleted:b3676286-2353-4328-82d5-f123f7bfbd1d for instance e7d7393f-d0b9-480d-bfe7-36439a86c064 on hv-cinder-85221 Sep 06 16:31:31.537670 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-f440727e-efb1-41cf-80d6-78f0a11ddef1 req-2bb225c0-5aba-4043-8ac3-8483e75cbf78 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036820 Sep 06 16:31:31.539784 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 675/1324] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:31:31.883485 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:31.884217 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:31.891516 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:31.892051 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:31.892512 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:31.893253 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:31.893730 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:31.894177 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:31.935585 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:31.935969 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:31.936398 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:31.936927 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lazy-loading 'fault' on Instance uuid e7d7393f-d0b9-480d-bfe7-36439a86c064 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:31:31.992352 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:32.001018 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-597ff4b1-5074-43d2-ab4a-92d95156a675 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 200 len: 1332 microversion: 2.1 time: 0.122297 Sep 06 16:31:32.001619 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 650/1325] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:31 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 1332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:33.026964 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-51f391d9-b0fe-471d-9d98-e5628036a7fa tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:33.027647 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-51f391d9-b0fe-471d-9d98-e5628036a7fa tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:33.036160 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-51f391d9-b0fe-471d-9d98-e5628036a7fa tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:33.037034 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-51f391d9-b0fe-471d-9d98-e5628036a7fa tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:33.037662 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-51f391d9-b0fe-471d-9d98-e5628036a7fa tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:33.038825 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-51f391d9-b0fe-471d-9d98-e5628036a7fa tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:33.039564 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-51f391d9-b0fe-471d-9d98-e5628036a7fa tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:33.040271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-51f391d9-b0fe-471d-9d98-e5628036a7fa tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:33.056380 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-51f391d9-b0fe-471d-9d98-e5628036a7fa tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-51f391d9-b0fe-471d-9d98-e5628036a7fa tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 HTTP/1.1 Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:31:33.058150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:31:33.059874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:31:33.059874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:31:33.059874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:31:33.059874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:31:33.059874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:31:33.059874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:31:33.059874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:31:33.059874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:31:33.059874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:31:33.059874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:31:33.059874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:31:33.059874 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'e7d7393f-d0b9-480d-bfe7-36439a86c064'} Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:31:33.060841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:31:33.062456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:31:33.063893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-51f391d9-b0fe-471d-9d98-e5628036a7fa tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 404 to user: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:31:33.063893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-51f391d9-b0fe-471d-9d98-e5628036a7fa tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 404 len: 111 microversion: 2.1 time: 0.037635 Sep 06 16:31:33.063893 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 676/1326] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:33 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:31:33.069014 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5b511cad-bb6a-422f-94ec-3246fa60765a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '.version_select at 0x7f83ecc63ca0>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:33.091299 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5b511cad-bb6a-422f-94ec-3246fa60765a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583234393" status: 202 len: 0 microversion: 2.1 time: 0.026279 Sep 06 16:31:33.091876 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 651/1327] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Sep 6 16:31:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583234393 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:31:34.080951 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-17177192-2b08-4f75-9e29-8fcc073b4958 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: .version_select at 0x7f83e9612670>, body: {"keypair": {"name": "tempest-keypair-23010825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjfnk3jLGoBhW1gXkRymfsNJ5ea5rUFfaFe7335VS15CVVSqTf2wheYRrw9gIKE2L9D24mECrzAiE2G2jvWG4meSNdVL8n0xeLN3MlkdZRksgdfWsS7TuObEGfZ4385Zw=="}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:31:34.097604 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-17177192-2b08-4f75-9e29-8fcc073b4958 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for project 5c722f58536f492aa4eb96085452def4. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:31:34.101654 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-17177192-2b08-4f75-9e29-8fcc073b4958 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for user 523faa1ac64e4044b9fb651ec28249d9 and project 5c722f58536f492aa4eb96085452def4. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:31:34.130785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-17177192-2b08-4f75-9e29-8fcc073b4958 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.054332 Sep 06 16:31:34.131379 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 677/1328] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 6 16:31:34 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:31:35.606810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-876048636", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4084decc-71da-4dac-8299-c3181b61526b"}], "security_groups": [{"name": "tempest-securitygroup--244259275"}], "key_name": "tempest-keypair-23010825", "user_data": "}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:31:35.724134 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] validate_networks() for [('4084decc-71da-4dac-8299-c3181b61526b', None, None, None, None, None)] {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:31:36.142577 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:31:36.143000 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:31:36.143502 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:31:36.143904 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:31:36.144348 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:31:36.154077 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:36.154554 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:36.155016 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:36.155965 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:36.156417 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:36.156868 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:36.175385 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for project 5c722f58536f492aa4eb96085452def4. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:31:36.179679 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for user 523faa1ac64e4044b9fb651ec28249d9 and project 5c722f58536f492aa4eb96085452def4. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:31:36.191753 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:31:36.194131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:31:36.248633 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-a61e5b6a-310e-43af-a727-305e632723b0 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.646499 Sep 06 16:31:36.249565 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 652/1329] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:31:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:31:36.264284 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-39c6c48a-471b-4fbb-a647-b0556a1f7e34 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:36.265109 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-39c6c48a-471b-4fbb-a647-b0556a1f7e34 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:36.329976 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-39c6c48a-471b-4fbb-a647-b0556a1f7e34 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:36.333475 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-39c6c48a-471b-4fbb-a647-b0556a1f7e34 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1239 microversion: 2.1 time: 0.074394 Sep 06 16:31:36.334083 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 678/1330] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:36 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:37.365000 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-2b5a8bf0-1603-417c-b547-81dca85c1e65 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:37.365618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-2b5a8bf0-1603-417c-b547-81dca85c1e65 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:37.373159 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2b5a8bf0-1603-417c-b547-81dca85c1e65 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:37.373652 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2b5a8bf0-1603-417c-b547-81dca85c1e65 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:37.374089 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2b5a8bf0-1603-417c-b547-81dca85c1e65 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:37.374827 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2b5a8bf0-1603-417c-b547-81dca85c1e65 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:37.375277 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2b5a8bf0-1603-417c-b547-81dca85c1e65 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:37.375697 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-2b5a8bf0-1603-417c-b547-81dca85c1e65 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:37.506580 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-2b5a8bf0-1603-417c-b547-81dca85c1e65 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:37.521310 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-2b5a8bf0-1603-417c-b547-81dca85c1e65 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1299 microversion: 2.1 time: 0.161309 Sep 06 16:31:37.522568 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 653/1331] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:37 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:38.546456 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1c642fcd-5dd1-4b40-a3a9-d47bfc13ac7e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:38.547258 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1c642fcd-5dd1-4b40-a3a9-d47bfc13ac7e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:38.554219 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1c642fcd-5dd1-4b40-a3a9-d47bfc13ac7e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:38.554810 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1c642fcd-5dd1-4b40-a3a9-d47bfc13ac7e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:38.555310 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1c642fcd-5dd1-4b40-a3a9-d47bfc13ac7e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:38.556395 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1c642fcd-5dd1-4b40-a3a9-d47bfc13ac7e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:38.557060 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1c642fcd-5dd1-4b40-a3a9-d47bfc13ac7e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:38.557578 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1c642fcd-5dd1-4b40-a3a9-d47bfc13ac7e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:38.706437 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1c642fcd-5dd1-4b40-a3a9-d47bfc13ac7e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:38.717649 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1c642fcd-5dd1-4b40-a3a9-d47bfc13ac7e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1364 microversion: 2.1 time: 0.175841 Sep 06 16:31:38.718248 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 679/1332] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:38 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:39.105701 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-cde0fd76-9c27-4193-8c6f-b136bfe2786a req-185c1733-827b-44a7-bcc4-5b272b7750ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64057754-3a69-4878-bec9-f7b1d6eeee24", "tag": "29aa6e89-aef8-4b28-ba22-6b6b14dc6f3f"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:31:39.116824 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-cde0fd76-9c27-4193-8c6f-b136bfe2786a req-185c1733-827b-44a7-bcc4-5b272b7750ff service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:39.119158 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-cde0fd76-9c27-4193-8c6f-b136bfe2786a req-185c1733-827b-44a7-bcc4-5b272b7750ff service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:39.119158 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-cde0fd76-9c27-4193-8c6f-b136bfe2786a req-185c1733-827b-44a7-bcc4-5b272b7750ff service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:39.131710 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-cde0fd76-9c27-4193-8c6f-b136bfe2786a req-185c1733-827b-44a7-bcc4-5b272b7750ff service nova] Creating event network-changed:29aa6e89-aef8-4b28-ba22-6b6b14dc6f3f for instance 64057754-3a69-4878-bec9-f7b1d6eeee24 on hv-cinder-85221 Sep 06 16:31:39.137026 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-cde0fd76-9c27-4193-8c6f-b136bfe2786a req-185c1733-827b-44a7-bcc4-5b272b7750ff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036106 Sep 06 16:31:39.137641 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 654/1333] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:31:39.741428 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-4dbacc25-f56c-49b8-9a22-4ae2406d1643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:39.742041 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-4dbacc25-f56c-49b8-9a22-4ae2406d1643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:39.749446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dbacc25-f56c-49b8-9a22-4ae2406d1643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:39.749880 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dbacc25-f56c-49b8-9a22-4ae2406d1643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:39.750329 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dbacc25-f56c-49b8-9a22-4ae2406d1643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:39.751065 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dbacc25-f56c-49b8-9a22-4ae2406d1643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:39.751513 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dbacc25-f56c-49b8-9a22-4ae2406d1643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:39.751975 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-4dbacc25-f56c-49b8-9a22-4ae2406d1643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:39.893503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-4dbacc25-f56c-49b8-9a22-4ae2406d1643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:39.902838 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-4dbacc25-f56c-49b8-9a22-4ae2406d1643 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1364 microversion: 2.1 time: 0.165266 Sep 06 16:31:39.903443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 680/1334] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:39 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:31:40.927580 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6604b891-f0e0-4a45-8ad3-ed4c4f0c959d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:40.928323 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6604b891-f0e0-4a45-8ad3-ed4c4f0c959d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:40.935815 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6604b891-f0e0-4a45-8ad3-ed4c4f0c959d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:40.936298 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6604b891-f0e0-4a45-8ad3-ed4c4f0c959d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:40.936783 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6604b891-f0e0-4a45-8ad3-ed4c4f0c959d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:40.937514 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6604b891-f0e0-4a45-8ad3-ed4c4f0c959d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:40.937968 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6604b891-f0e0-4a45-8ad3-ed4c4f0c959d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:40.938414 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6604b891-f0e0-4a45-8ad3-ed4c4f0c959d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:41.082938 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-6604b891-f0e0-4a45-8ad3-ed4c4f0c959d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:41.091405 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6604b891-f0e0-4a45-8ad3-ed4c4f0c959d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1364 microversion: 2.1 time: 0.168415 Sep 06 16:31:41.091980 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 655/1335] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:40 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:42.118785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b55999dc-482a-4076-9527-03efd9cab3e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:42.119440 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b55999dc-482a-4076-9527-03efd9cab3e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:42.126933 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b55999dc-482a-4076-9527-03efd9cab3e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:42.127462 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b55999dc-482a-4076-9527-03efd9cab3e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:42.127896 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b55999dc-482a-4076-9527-03efd9cab3e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:42.128602 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b55999dc-482a-4076-9527-03efd9cab3e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:42.129091 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b55999dc-482a-4076-9527-03efd9cab3e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:42.129511 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b55999dc-482a-4076-9527-03efd9cab3e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:42.279283 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-b55999dc-482a-4076-9527-03efd9cab3e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:42.291577 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b55999dc-482a-4076-9527-03efd9cab3e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1364 microversion: 2.1 time: 0.179990 Sep 06 16:31:42.292334 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 681/1336] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:42 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:31:43.316641 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-bc1950e2-39fe-428d-b313-59d0ceedd51d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:43.317351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-bc1950e2-39fe-428d-b313-59d0ceedd51d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:43.325449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc1950e2-39fe-428d-b313-59d0ceedd51d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:43.325945 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc1950e2-39fe-428d-b313-59d0ceedd51d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:43.326391 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc1950e2-39fe-428d-b313-59d0ceedd51d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:43.327151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc1950e2-39fe-428d-b313-59d0ceedd51d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:43.327634 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc1950e2-39fe-428d-b313-59d0ceedd51d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:43.328100 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-bc1950e2-39fe-428d-b313-59d0ceedd51d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:43.480865 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-bc1950e2-39fe-428d-b313-59d0ceedd51d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:43.489599 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-bc1950e2-39fe-428d-b313-59d0ceedd51d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1364 microversion: 2.1 time: 0.177428 Sep 06 16:31:43.490208 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 656/1337] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:43 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:44.513292 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2975f996-0036-442d-85a8-13add0693418 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:44.514041 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2975f996-0036-442d-85a8-13add0693418 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:44.521670 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2975f996-0036-442d-85a8-13add0693418 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:44.522151 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2975f996-0036-442d-85a8-13add0693418 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:44.522588 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2975f996-0036-442d-85a8-13add0693418 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:44.523327 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2975f996-0036-442d-85a8-13add0693418 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:44.523774 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2975f996-0036-442d-85a8-13add0693418 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:44.524197 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2975f996-0036-442d-85a8-13add0693418 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:44.676190 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2975f996-0036-442d-85a8-13add0693418 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:44.685300 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2975f996-0036-442d-85a8-13add0693418 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1364 microversion: 2.1 time: 0.175709 Sep 06 16:31:44.686276 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 682/1338] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:44 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:45.722884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c46ccb4a-8589-4422-912d-9abb72150a04 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:45.723529 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c46ccb4a-8589-4422-912d-9abb72150a04 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:45.731334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c46ccb4a-8589-4422-912d-9abb72150a04 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:45.731858 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c46ccb4a-8589-4422-912d-9abb72150a04 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:45.732294 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c46ccb4a-8589-4422-912d-9abb72150a04 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:45.733043 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c46ccb4a-8589-4422-912d-9abb72150a04 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:45.733491 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c46ccb4a-8589-4422-912d-9abb72150a04 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:45.734011 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c46ccb4a-8589-4422-912d-9abb72150a04 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:45.894185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c46ccb4a-8589-4422-912d-9abb72150a04 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:45.905623 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-d4151ded-0b63-439a-a158-3622d5dab4a0 req-5e8bc80d-b4e6-48e1-bd9d-17f558cae4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64057754-3a69-4878-bec9-f7b1d6eeee24", "name": "network-vif-plugged", "status": "completed", "tag": "29aa6e89-aef8-4b28-ba22-6b6b14dc6f3f"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:31:45.915522 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c46ccb4a-8589-4422-912d-9abb72150a04 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1364 microversion: 2.1 time: 0.196657 Sep 06 16:31:45.916610 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 657/1339] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:45 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:45.918390 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-d4151ded-0b63-439a-a158-3622d5dab4a0 req-5e8bc80d-b4e6-48e1-bd9d-17f558cae4fc service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:45.918873 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-d4151ded-0b63-439a-a158-3622d5dab4a0 req-5e8bc80d-b4e6-48e1-bd9d-17f558cae4fc service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:45.919296 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-d4151ded-0b63-439a-a158-3622d5dab4a0 req-5e8bc80d-b4e6-48e1-bd9d-17f558cae4fc service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:45.935333 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-d4151ded-0b63-439a-a158-3622d5dab4a0 req-5e8bc80d-b4e6-48e1-bd9d-17f558cae4fc service nova] Creating event network-vif-plugged:29aa6e89-aef8-4b28-ba22-6b6b14dc6f3f for instance 64057754-3a69-4878-bec9-f7b1d6eeee24 on hv-cinder-85221 Sep 06 16:31:45.942663 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-d4151ded-0b63-439a-a158-3622d5dab4a0 req-5e8bc80d-b4e6-48e1-bd9d-17f558cae4fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040918 Sep 06 16:31:45.943517 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 683/1340] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:31:46.944826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5c84228c-e5e0-43cd-a740-16e70d2a711d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:46.945572 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5c84228c-e5e0-43cd-a740-16e70d2a711d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:46.947651 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:31:46.948429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=6 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:31:46.955884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c84228c-e5e0-43cd-a740-16e70d2a711d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:46.956388 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c84228c-e5e0-43cd-a740-16e70d2a711d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:46.956832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c84228c-e5e0-43cd-a740-16e70d2a711d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:46.957544 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c84228c-e5e0-43cd-a740-16e70d2a711d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:46.957996 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c84228c-e5e0-43cd-a740-16e70d2a711d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:46.958421 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c84228c-e5e0-43cd-a740-16e70d2a711d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:47.113216 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5c84228c-e5e0-43cd-a740-16e70d2a711d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:47.121681 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5c84228c-e5e0-43cd-a740-16e70d2a711d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1364 microversion: 2.1 time: 0.181197 Sep 06 16:31:47.122315 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 658/1341] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:46 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:48.142281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=6 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:31:48.147398 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-2cc88c19-56d7-4e65-af8b-bd8ed7ffe994 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:48.148088 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-2cc88c19-56d7-4e65-af8b-bd8ed7ffe994 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:48.155023 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2cc88c19-56d7-4e65-af8b-bd8ed7ffe994 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:48.155499 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2cc88c19-56d7-4e65-af8b-bd8ed7ffe994 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:48.155953 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2cc88c19-56d7-4e65-af8b-bd8ed7ffe994 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:48.156615 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2cc88c19-56d7-4e65-af8b-bd8ed7ffe994 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:48.157089 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2cc88c19-56d7-4e65-af8b-bd8ed7ffe994 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:48.157506 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-2cc88c19-56d7-4e65-af8b-bd8ed7ffe994 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:48.300904 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-2cc88c19-56d7-4e65-af8b-bd8ed7ffe994 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:48.309979 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-2cc88c19-56d7-4e65-af8b-bd8ed7ffe994 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1555 microversion: 2.1 time: 0.168610 Sep 06 16:31:48.310546 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 684/1342] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:31:48 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:31:48.332534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d51a59be-ebf0-45f2-a991-50f1f08f8080 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:48.333210 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d51a59be-ebf0-45f2-a991-50f1f08f8080 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:48.342554 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d51a59be-ebf0-45f2-a991-50f1f08f8080 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:48.343071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d51a59be-ebf0-45f2-a991-50f1f08f8080 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:48.343494 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d51a59be-ebf0-45f2-a991-50f1f08f8080 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:48.344228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d51a59be-ebf0-45f2-a991-50f1f08f8080 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:48.344676 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d51a59be-ebf0-45f2-a991-50f1f08f8080 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:48.345123 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d51a59be-ebf0-45f2-a991-50f1f08f8080 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:48.433993 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d51a59be-ebf0-45f2-a991-50f1f08f8080 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105130 Sep 06 16:31:48.434761 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 659/1343] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 6 16:31:48 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:31:49.692594 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-166a7f48-4830-480d-8c8c-19d6229c9e58 req-a3cfe7a0-e6df-498d-a7cf-b1386409ac22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64057754-3a69-4878-bec9-f7b1d6eeee24", "tag": "29aa6e89-aef8-4b28-ba22-6b6b14dc6f3f"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:31:49.703156 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-166a7f48-4830-480d-8c8c-19d6229c9e58 req-a3cfe7a0-e6df-498d-a7cf-b1386409ac22 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:49.703625 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-166a7f48-4830-480d-8c8c-19d6229c9e58 req-a3cfe7a0-e6df-498d-a7cf-b1386409ac22 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:49.704038 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-166a7f48-4830-480d-8c8c-19d6229c9e58 req-a3cfe7a0-e6df-498d-a7cf-b1386409ac22 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:49.716283 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-166a7f48-4830-480d-8c8c-19d6229c9e58 req-a3cfe7a0-e6df-498d-a7cf-b1386409ac22 service nova] Creating event network-changed:29aa6e89-aef8-4b28-ba22-6b6b14dc6f3f for instance 64057754-3a69-4878-bec9-f7b1d6eeee24 on hv-cinder-85221 Sep 06 16:31:49.721545 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-166a7f48-4830-480d-8c8c-19d6229c9e58 req-a3cfe7a0-e6df-498d-a7cf-b1386409ac22 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032535 Sep 06 16:31:49.722321 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 685/1344] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:33:04.895057 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:33:04.895836 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:33:05.026324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-b919bbf4-2cc4-4db2-bb85-2f03e87bd022 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:05.026855 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-b919bbf4-2cc4-4db2-bb85-2f03e87bd022 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:05.033266 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b919bbf4-2cc4-4db2-bb85-2f03e87bd022 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:05.033745 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b919bbf4-2cc4-4db2-bb85-2f03e87bd022 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:05.034181 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b919bbf4-2cc4-4db2-bb85-2f03e87bd022 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:05.034881 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b919bbf4-2cc4-4db2-bb85-2f03e87bd022 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:05.035328 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b919bbf4-2cc4-4db2-bb85-2f03e87bd022 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:05.035724 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-b919bbf4-2cc4-4db2-bb85-2f03e87bd022 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:05.062657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-b919bbf4-2cc4-4db2-bb85-2f03e87bd022 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/ips" status: 200 len: 150 microversion: 2.1 time: 0.169514 Sep 06 16:33:05.063216 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 660/1345] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 6 16:33:04 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/ips => generated 150 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:33:06.412966 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:33:06.413709 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:33:06.420882 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-482be275-e0f6-4947-8226-6771b2e8e49c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d285734-3312-4c82-9f07-9f9557bcd0f1"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:33:06.427054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-482be275-e0f6-4947-8226-6771b2e8e49c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:06.432939 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-482be275-e0f6-4947-8226-6771b2e8e49c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:06.433436 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-482be275-e0f6-4947-8226-6771b2e8e49c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:06.433869 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-482be275-e0f6-4947-8226-6771b2e8e49c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:06.434576 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-482be275-e0f6-4947-8226-6771b2e8e49c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:06.435027 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-482be275-e0f6-4947-8226-6771b2e8e49c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:06.435449 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-482be275-e0f6-4947-8226-6771b2e8e49c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:06.727393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-482be275-e0f6-4947-8226-6771b2e8e49c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316248 Sep 06 16:33:06.728038 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 686/1346] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:33:06 2022] POST /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:33:14.305743 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c982f08d-8e98-4457-8251-54816a93a90e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d285734-3312-4c82-9f07-9f9557bcd0f1"}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:33:14.308212 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c982f08d-8e98-4457-8251-54816a93a90e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:14.315131 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c982f08d-8e98-4457-8251-54816a93a90e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:14.315614 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c982f08d-8e98-4457-8251-54816a93a90e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:14.316051 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c982f08d-8e98-4457-8251-54816a93a90e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:14.316747 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c982f08d-8e98-4457-8251-54816a93a90e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:14.317232 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c982f08d-8e98-4457-8251-54816a93a90e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:14.317661 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c982f08d-8e98-4457-8251-54816a93a90e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:14.398814 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-c982f08d-8e98-4457-8251-54816a93a90e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Invalid volume: volume 6d285734-3312-4c82-9f07-9f9557bcd0f1 is already attached to instances: 64057754-3a69-4878-bec9-f7b1d6eeee24 Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c982f08d-8e98-4457-8251-54816a93a90e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: POST /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-volume_attachments HTTP/1.1 Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 74 Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:33:14.400555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:33:14.402219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:33:14.402219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:33:14.402219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:33:14.402219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:33:14.402219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:33:14.402219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:33:14.402219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:33:14.402219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:33:14.402219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:33:14.402219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Sep 06 16:33:14.402219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {"volumeAttachment": {"volumeId": "6d285734-3312-4c82-9f07-9f9557bcd0f1"}} Sep 06 16:33:14.402219 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Invalid volume: volume 6d285734-3312-4c82-9f07-9f9557bcd0f1 is already attached to instances: 64057754-3a69-4878-bec9-f7b1d6eeee24 Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'server_id': '64057754-3a69-4878-bec9-f7b1d6eeee24', 'body': {'volumeAttachment': {'volumeId': '6d285734-3312-4c82-9f07-9f9557bcd0f1'}}} Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6d285734-3312-4c82-9f07-9f9557bcd0f1 is already attached to instances: 64057754-3a69-4878-bec9-f7b1d6eeee24 Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:33:14.403189 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6d285734-3312-4c82-9f07-9f9557bcd0f1 is already attached to instances: 64057754-3a69-4878-bec9-f7b1d6eeee24 Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:33:14.404895 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:33:14.407142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:33:14.407142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:33:14.407142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:33:14.407142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6d285734-3312-4c82-9f07-9f9557bcd0f1 is already attached to instances: 64057754-3a69-4878-bec9-f7b1d6eeee24 Sep 06 16:33:14.407142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:33:14.407142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c982f08d-8e98-4457-8251-54816a93a90e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 400 to user: Invalid volume: volume 6d285734-3312-4c82-9f07-9f9557bcd0f1 is already attached to instances: 64057754-3a69-4878-bec9-f7b1d6eeee24 {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:33:14.407142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c982f08d-8e98-4457-8251-54816a93a90e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100377 Sep 06 16:33:14.407142 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 661/1347] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:33:14 2022] POST /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:33:14.472421 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-cdf404f8-c5ff-43a5-bf90-b967a660bc2c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:14.473031 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-cdf404f8-c5ff-43a5-bf90-b967a660bc2c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:14.479714 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cdf404f8-c5ff-43a5-bf90-b967a660bc2c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:14.480194 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cdf404f8-c5ff-43a5-bf90-b967a660bc2c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:14.480625 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cdf404f8-c5ff-43a5-bf90-b967a660bc2c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:14.481313 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cdf404f8-c5ff-43a5-bf90-b967a660bc2c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:14.481827 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cdf404f8-c5ff-43a5-bf90-b967a660bc2c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:14.482241 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cdf404f8-c5ff-43a5-bf90-b967a660bc2c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:14.564981 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.objects.instance [None req-cdf404f8-c5ff-43a5-bf90-b967a660bc2c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lazy-loading 'services' on Instance uuid 64057754-3a69-4878-bec9-f7b1d6eeee24 {{(pid=120668) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:33:14.640092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-cdf404f8-c5ff-43a5-bf90-b967a660bc2c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-volume_attachments/6d285734-3312-4c82-9f07-9f9557bcd0f1" status: 202 len: 0 microversion: 2.1 time: 0.172542 Sep 06 16:33:14.640717 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 687/1348] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 6 16:33:14 2022] DELETE /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-volume_attachments/6d285734-3312-4c82-9f07-9f9557bcd0f1 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:33:14.649197 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-d35a1ed3-6032-413f-91f3-f43ca3cb26d1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:14.651619 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-d35a1ed3-6032-413f-91f3-f43ca3cb26d1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:14.657968 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d35a1ed3-6032-413f-91f3-f43ca3cb26d1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:14.658847 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d35a1ed3-6032-413f-91f3-f43ca3cb26d1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:14.659077 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d35a1ed3-6032-413f-91f3-f43ca3cb26d1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:14.659780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d35a1ed3-6032-413f-91f3-f43ca3cb26d1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:14.660228 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d35a1ed3-6032-413f-91f3-f43ca3cb26d1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:14.660649 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-d35a1ed3-6032-413f-91f3-f43ca3cb26d1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:14.692229 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-d35a1ed3-6032-413f-91f3-f43ca3cb26d1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046841 Sep 06 16:33:14.692872 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 662/1349] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:33:14 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:33:15.705308 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fe6c547e-e590-4cd4-9ec0-20a23b40f44a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:15.707533 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fe6c547e-e590-4cd4-9ec0-20a23b40f44a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:15.716048 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fe6c547e-e590-4cd4-9ec0-20a23b40f44a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:15.716547 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fe6c547e-e590-4cd4-9ec0-20a23b40f44a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:15.717021 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fe6c547e-e590-4cd4-9ec0-20a23b40f44a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:15.717721 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fe6c547e-e590-4cd4-9ec0-20a23b40f44a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:15.718168 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fe6c547e-e590-4cd4-9ec0-20a23b40f44a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:15.718585 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fe6c547e-e590-4cd4-9ec0-20a23b40f44a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:15.748503 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fe6c547e-e590-4cd4-9ec0-20a23b40f44a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048203 Sep 06 16:33:15.749090 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 688/1350] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:33:15 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:33:15.813068 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1658ee67-894d-432b-af78-bf16072c23f9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:15.813670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1658ee67-894d-432b-af78-bf16072c23f9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:15.823678 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1658ee67-894d-432b-af78-bf16072c23f9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:15.824152 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1658ee67-894d-432b-af78-bf16072c23f9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:15.824595 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1658ee67-894d-432b-af78-bf16072c23f9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:15.825309 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1658ee67-894d-432b-af78-bf16072c23f9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:15.825753 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1658ee67-894d-432b-af78-bf16072c23f9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:15.826174 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1658ee67-894d-432b-af78-bf16072c23f9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:15.851797 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1658ee67-894d-432b-af78-bf16072c23f9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Going to try to terminate instance {{(pid=120669) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:33:15.929299 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1658ee67-894d-432b-af78-bf16072c23f9 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 204 len: 0 microversion: 2.1 time: 0.120048 Sep 06 16:33:15.929927 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 663/1351] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:33:15 2022] DELETE /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:33:15.938236 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-76432a73-0b2a-4917-8ce1-f4a7543c38b7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:15.938842 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-76432a73-0b2a-4917-8ce1-f4a7543c38b7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:15.945019 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76432a73-0b2a-4917-8ce1-f4a7543c38b7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:15.945501 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76432a73-0b2a-4917-8ce1-f4a7543c38b7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:15.945913 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76432a73-0b2a-4917-8ce1-f4a7543c38b7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:15.946597 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76432a73-0b2a-4917-8ce1-f4a7543c38b7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:15.947047 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76432a73-0b2a-4917-8ce1-f4a7543c38b7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:15.947465 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76432a73-0b2a-4917-8ce1-f4a7543c38b7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:16.083065 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-76432a73-0b2a-4917-8ce1-f4a7543c38b7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:16.091035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-76432a73-0b2a-4917-8ce1-f4a7543c38b7 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1679 microversion: 2.1 time: 0.156695 Sep 06 16:33:16.091642 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 689/1352] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:15 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:17.116070 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-e4b2077e-3774-40b6-b7af-7113b315ed77 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:17.116713 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-e4b2077e-3774-40b6-b7af-7113b315ed77 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:17.123866 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e4b2077e-3774-40b6-b7af-7113b315ed77 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:17.124455 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e4b2077e-3774-40b6-b7af-7113b315ed77 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:17.124938 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e4b2077e-3774-40b6-b7af-7113b315ed77 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:17.125632 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e4b2077e-3774-40b6-b7af-7113b315ed77 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:17.126075 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e4b2077e-3774-40b6-b7af-7113b315ed77 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:17.126490 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-e4b2077e-3774-40b6-b7af-7113b315ed77 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:17.259043 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-e4b2077e-3774-40b6-b7af-7113b315ed77 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:17.266983 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-e4b2077e-3774-40b6-b7af-7113b315ed77 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1679 microversion: 2.1 time: 0.155264 Sep 06 16:33:17.267553 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 664/1353] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:17 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:18.291013 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a4cfce7b-c45c-4652-8d35-6f95f5af430e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:18.291621 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a4cfce7b-c45c-4652-8d35-6f95f5af430e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:18.300004 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4cfce7b-c45c-4652-8d35-6f95f5af430e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:18.300542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4cfce7b-c45c-4652-8d35-6f95f5af430e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:18.301065 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4cfce7b-c45c-4652-8d35-6f95f5af430e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:18.301810 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4cfce7b-c45c-4652-8d35-6f95f5af430e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:18.302264 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4cfce7b-c45c-4652-8d35-6f95f5af430e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:18.302688 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a4cfce7b-c45c-4652-8d35-6f95f5af430e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:18.432789 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-a4cfce7b-c45c-4652-8d35-6f95f5af430e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:18.440612 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a4cfce7b-c45c-4652-8d35-6f95f5af430e tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 200 len: 1679 microversion: 2.1 time: 0.154106 Sep 06 16:33:18.441221 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 690/1354] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:18 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:18.929990 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-dce965d3-93f3-4b05-b8b3-eeab871e24d6 req-962d4d42-cb93-4963-93af-017c82b57675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64057754-3a69-4878-bec9-f7b1d6eeee24", "name": "network-vif-deleted", "tag": "29aa6e89-aef8-4b28-ba22-6b6b14dc6f3f"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:33:18.945804 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-dce965d3-93f3-4b05-b8b3-eeab871e24d6 req-962d4d42-cb93-4963-93af-017c82b57675 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:18.947324 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-dce965d3-93f3-4b05-b8b3-eeab871e24d6 req-962d4d42-cb93-4963-93af-017c82b57675 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:18.948230 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-dce965d3-93f3-4b05-b8b3-eeab871e24d6 req-962d4d42-cb93-4963-93af-017c82b57675 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:18.965784 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-dce965d3-93f3-4b05-b8b3-eeab871e24d6 req-962d4d42-cb93-4963-93af-017c82b57675 service nova] Creating event network-vif-deleted:29aa6e89-aef8-4b28-ba22-6b6b14dc6f3f for instance 64057754-3a69-4878-bec9-f7b1d6eeee24 on hv-cinder-85221 Sep 06 16:33:18.973725 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-dce965d3-93f3-4b05-b8b3-eeab871e24d6 req-962d4d42-cb93-4963-93af-017c82b57675 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106912 Sep 06 16:33:18.974884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 665/1355] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:33:19.463720 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1db9191e-3744-44a6-8b35-d075ce63ce6c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:19.464360 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1db9191e-3744-44a6-8b35-d075ce63ce6c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:19.471115 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1db9191e-3744-44a6-8b35-d075ce63ce6c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:19.471632 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1db9191e-3744-44a6-8b35-d075ce63ce6c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:19.472070 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1db9191e-3744-44a6-8b35-d075ce63ce6c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:19.473107 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1db9191e-3744-44a6-8b35-d075ce63ce6c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:19.473757 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1db9191e-3744-44a6-8b35-d075ce63ce6c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:19.474186 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1db9191e-3744-44a6-8b35-d075ce63ce6c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:19.491450 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-1db9191e-3744-44a6-8b35-d075ce63ce6c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1db9191e-3744-44a6-8b35-d075ce63ce6c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 HTTP/1.1 Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:33:19.493173 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:33:19.495043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:33:19.495043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:33:19.495043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:33:19.495043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:33:19.495043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:33:19.495043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:33:19.495043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:33:19.495043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:33:19.495043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:33:19.495043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:33:19.495043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:33:19.495043 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': '64057754-3a69-4878-bec9-f7b1d6eeee24'} Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:33:19.496400 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:33:19.498474 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:33:19.500478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1db9191e-3744-44a6-8b35-d075ce63ce6c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 404 to user: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:33:19.500478 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1db9191e-3744-44a6-8b35-d075ce63ce6c tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 404 len: 111 microversion: 2.1 time: 0.034894 Sep 06 16:33:19.504688 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 691/1356] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:19 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 16:33:19.504929 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-ee760c59-56b1-4458-97cf-eac78079979a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '.version_select at 0x7f83eccd6670>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:19.526099 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-ee760c59-56b1-4458-97cf-eac78079979a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-23010825" status: 202 len: 0 microversion: 2.1 time: 0.025740 Sep 06 16:33:19.528800 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 666/1357] 10.222.0.43 () {58 vars in 1215 bytes} [Tue Sep 6 16:33:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-23010825 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:33:20.209179 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-e6f76bac-daf0-466d-a1ae-4bb1bc4ee35b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: .version_select at 0x7f83ea20a550>, body: {"keypair": {"name": "tempest-keypair-2061128481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVk2QOCzcH+CYtFSvVKrnkbAsA2rJBExbc6FxXo8sXx03Y+iuReI+kbSq8xNO+ijc3jKdkSpPVqzsJTjcfdXMiwj4wAHGymvjpBN8EmT0HRMgi6vwPp1P2JdueSmpeGGQ=="}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:33:20.229644 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-e6f76bac-daf0-466d-a1ae-4bb1bc4ee35b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for project 5c722f58536f492aa4eb96085452def4. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:33:20.234088 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.quota [None req-e6f76bac-daf0-466d-a1ae-4bb1bc4ee35b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for user 523faa1ac64e4044b9fb651ec28249d9 and project 5c722f58536f492aa4eb96085452def4. Resources: {'key_pairs'} {{(pid=120668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:33:20.259828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-e6f76bac-daf0-466d-a1ae-4bb1bc4ee35b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055197 Sep 06 16:33:20.260431 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 692/1358] 10.222.0.43 () {60 vars in 1159 bytes} [Tue Sep 6 16:33:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:33:21.545212 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1294886612", "imageRef": "f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4084decc-71da-4dac-8299-c3181b61526b"}], "security_groups": [{"name": "tempest-securitygroup--176277485"}], "key_name": "tempest-keypair-2061128481", "user_data": "}} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:33:21.659823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.network.neutron [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] validate_networks() for [('4084decc-71da-4dac-8299-c3181b61526b', None, None, None, None, None)] {{(pid=120669) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:33:22.050100 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Flavor limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:33:22.050547 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Image limits 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:33:22.051026 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Flavor pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:33:22.051436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Image pref 0:0:0 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:33:22.051876 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.virt.hardware [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:33:22.061992 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:22.062457 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:22.062893 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:22.063618 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:22.064088 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:22.064511 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:22.083258 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for project 5c722f58536f492aa4eb96085452def4. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:33:22.087666 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.quota [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Getting quotas for user 523faa1ac64e4044b9fb651ec28249d9 and project 5c722f58536f492aa4eb96085452def4. Resources: {'ram', 'cores', 'instances'} {{(pid=120669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:33:22.099225 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Going to run 1 instances... {{(pid=120669) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:33:22.102055 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1d1c7b5-04ab-4994-8bf5-45f4cbeafce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:33:22.153421 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9f77d2d5-6d08-4e3c-8f0d-26d4e02fb0be tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.613679 Sep 06 16:33:22.160437 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 667/1359] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Sep 6 16:33:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:33:22.165898 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6d99a1bb-45c4-42d7-9249-5de8a317d8ad tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:22.166485 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6d99a1bb-45c4-42d7-9249-5de8a317d8ad tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:22.225375 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6d99a1bb-45c4-42d7-9249-5de8a317d8ad tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:22.233971 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6d99a1bb-45c4-42d7-9249-5de8a317d8ad tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1242 microversion: 2.1 time: 0.072076 Sep 06 16:33:22.234555 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 693/1360] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:22 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:33:23.258172 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-c16c3b84-fac7-4056-b492-f8895b9c822b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:23.258834 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-c16c3b84-fac7-4056-b492-f8895b9c822b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:23.267561 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c16c3b84-fac7-4056-b492-f8895b9c822b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:23.268115 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c16c3b84-fac7-4056-b492-f8895b9c822b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:23.268597 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c16c3b84-fac7-4056-b492-f8895b9c822b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:23.269673 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c16c3b84-fac7-4056-b492-f8895b9c822b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:23.270141 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c16c3b84-fac7-4056-b492-f8895b9c822b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:23.270616 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-c16c3b84-fac7-4056-b492-f8895b9c822b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:23.343769 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-c16c3b84-fac7-4056-b492-f8895b9c822b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:23.352252 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-c16c3b84-fac7-4056-b492-f8895b9c822b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1294 microversion: 2.1 time: 0.099515 Sep 06 16:33:23.353060 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 668/1361] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:23 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:24.375996 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-f6ee3170-cf35-43fc-9a63-94e9879f51b8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:24.376629 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-f6ee3170-cf35-43fc-9a63-94e9879f51b8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:24.383940 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f6ee3170-cf35-43fc-9a63-94e9879f51b8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:24.384424 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f6ee3170-cf35-43fc-9a63-94e9879f51b8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:24.384985 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f6ee3170-cf35-43fc-9a63-94e9879f51b8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:24.385682 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f6ee3170-cf35-43fc-9a63-94e9879f51b8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:24.386124 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f6ee3170-cf35-43fc-9a63-94e9879f51b8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:24.386539 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-f6ee3170-cf35-43fc-9a63-94e9879f51b8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:24.524542 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-f6ee3170-cf35-43fc-9a63-94e9879f51b8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:24.532787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-f6ee3170-cf35-43fc-9a63-94e9879f51b8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1367 microversion: 2.1 time: 0.160780 Sep 06 16:33:24.533368 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 694/1362] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:24 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:24.949594 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-70643fc1-13cc-4865-a85a-a5b674c2152b req-17757144-b332-4e44-8e03-922b4a647e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d22d29-352f-4e8f-8ef3-de43737e3ce8", "tag": "512c569c-063e-4ed3-b385-2a10ea7e3cd7"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:33:24.961102 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-70643fc1-13cc-4865-a85a-a5b674c2152b req-17757144-b332-4e44-8e03-922b4a647e50 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:24.961667 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-70643fc1-13cc-4865-a85a-a5b674c2152b req-17757144-b332-4e44-8e03-922b4a647e50 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:24.962527 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-70643fc1-13cc-4865-a85a-a5b674c2152b req-17757144-b332-4e44-8e03-922b4a647e50 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:24.975832 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-70643fc1-13cc-4865-a85a-a5b674c2152b req-17757144-b332-4e44-8e03-922b4a647e50 service nova] Creating event network-changed:512c569c-063e-4ed3-b385-2a10ea7e3cd7 for instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 on hv-cinder-85221 Sep 06 16:33:24.981076 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-70643fc1-13cc-4865-a85a-a5b674c2152b req-17757144-b332-4e44-8e03-922b4a647e50 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035259 Sep 06 16:33:24.981683 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 669/1363] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:33:25.556257 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-1b2e3691-275c-41c5-842e-c2a49a86fd50 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:25.556977 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-1b2e3691-275c-41c5-842e-c2a49a86fd50 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:25.563837 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1b2e3691-275c-41c5-842e-c2a49a86fd50 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:25.564413 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1b2e3691-275c-41c5-842e-c2a49a86fd50 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:25.564948 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1b2e3691-275c-41c5-842e-c2a49a86fd50 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:25.565651 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1b2e3691-275c-41c5-842e-c2a49a86fd50 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:25.566099 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1b2e3691-275c-41c5-842e-c2a49a86fd50 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:25.566518 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-1b2e3691-275c-41c5-842e-c2a49a86fd50 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:25.700211 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-1b2e3691-275c-41c5-842e-c2a49a86fd50 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:25.708238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-1b2e3691-275c-41c5-842e-c2a49a86fd50 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1367 microversion: 2.1 time: 0.156288 Sep 06 16:33:25.708845 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 695/1364] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:25 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:26.731809 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-db3d3eb1-68c5-4210-9d54-e61d8974668a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:26.732444 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-db3d3eb1-68c5-4210-9d54-e61d8974668a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:26.739630 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-db3d3eb1-68c5-4210-9d54-e61d8974668a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:26.740110 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-db3d3eb1-68c5-4210-9d54-e61d8974668a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:26.740544 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-db3d3eb1-68c5-4210-9d54-e61d8974668a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:26.741271 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-db3d3eb1-68c5-4210-9d54-e61d8974668a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:26.741722 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-db3d3eb1-68c5-4210-9d54-e61d8974668a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:26.742133 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-db3d3eb1-68c5-4210-9d54-e61d8974668a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:26.874035 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-db3d3eb1-68c5-4210-9d54-e61d8974668a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:26.882263 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-db3d3eb1-68c5-4210-9d54-e61d8974668a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1367 microversion: 2.1 time: 0.155147 Sep 06 16:33:26.882881 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 670/1365] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:26 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:27.905781 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-cb032d47-f05f-40e1-8767-8557d72de018 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:27.906396 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-cb032d47-f05f-40e1-8767-8557d72de018 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:27.913780 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cb032d47-f05f-40e1-8767-8557d72de018 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:27.914267 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cb032d47-f05f-40e1-8767-8557d72de018 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:27.914696 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cb032d47-f05f-40e1-8767-8557d72de018 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:27.915391 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cb032d47-f05f-40e1-8767-8557d72de018 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:27.915841 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cb032d47-f05f-40e1-8767-8557d72de018 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:27.916295 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-cb032d47-f05f-40e1-8767-8557d72de018 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:28.053319 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-cb032d47-f05f-40e1-8767-8557d72de018 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:28.062882 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-cb032d47-f05f-40e1-8767-8557d72de018 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1367 microversion: 2.1 time: 0.161097 Sep 06 16:33:28.063788 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 696/1366] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:27 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:29.089105 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-11dc820a-c9d8-4801-bb8a-2ae31970dd18 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:29.090025 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-11dc820a-c9d8-4801-bb8a-2ae31970dd18 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:29.098670 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-11dc820a-c9d8-4801-bb8a-2ae31970dd18 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:29.099141 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-11dc820a-c9d8-4801-bb8a-2ae31970dd18 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:29.099540 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-11dc820a-c9d8-4801-bb8a-2ae31970dd18 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:29.100235 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-11dc820a-c9d8-4801-bb8a-2ae31970dd18 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:29.100681 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-11dc820a-c9d8-4801-bb8a-2ae31970dd18 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:29.101179 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-11dc820a-c9d8-4801-bb8a-2ae31970dd18 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:29.252988 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-11dc820a-c9d8-4801-bb8a-2ae31970dd18 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:29.261434 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-11dc820a-c9d8-4801-bb8a-2ae31970dd18 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1367 microversion: 2.1 time: 0.177905 Sep 06 16:33:29.262071 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 671/1367] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:29 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:30.284819 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-749130b1-303b-483b-ad1a-d15c728768b5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:30.285443 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-749130b1-303b-483b-ad1a-d15c728768b5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:30.292732 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-749130b1-303b-483b-ad1a-d15c728768b5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:30.293579 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-749130b1-303b-483b-ad1a-d15c728768b5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:30.293991 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-749130b1-303b-483b-ad1a-d15c728768b5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:30.294691 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-749130b1-303b-483b-ad1a-d15c728768b5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:30.295138 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-749130b1-303b-483b-ad1a-d15c728768b5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:30.295573 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-749130b1-303b-483b-ad1a-d15c728768b5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:30.430823 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [req-b34f35d9-fee5-4331-874b-e88d5d76b9c7 req-e378b114-e98b-47b1-8ce5-22654e600dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d22d29-352f-4e8f-8ef3-de43737e3ce8", "name": "network-vif-plugged", "status": "completed", "tag": "512c569c-063e-4ed3-b385-2a10ea7e3cd7"}]} {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:33:30.440976 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-b34f35d9-fee5-4331-874b-e88d5d76b9c7 req-e378b114-e98b-47b1-8ce5-22654e600dfa service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:30.441531 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-b34f35d9-fee5-4331-874b-e88d5d76b9c7 req-e378b114-e98b-47b1-8ce5-22654e600dfa service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:30.442199 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [req-b34f35d9-fee5-4331-874b-e88d5d76b9c7 req-e378b114-e98b-47b1-8ce5-22654e600dfa service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:30.454229 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.compute.server_external_events [req-b34f35d9-fee5-4331-874b-e88d5d76b9c7 req-e378b114-e98b-47b1-8ce5-22654e600dfa service nova] Creating event network-vif-plugged:512c569c-063e-4ed3-b385-2a10ea7e3cd7 for instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 on hv-cinder-85221 Sep 06 16:33:30.455715 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-749130b1-303b-483b-ad1a-d15c728768b5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:30.459529 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [req-b34f35d9-fee5-4331-874b-e88d5d76b9c7 req-e378b114-e98b-47b1-8ce5-22654e600dfa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104293 Sep 06 16:33:30.460135 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 672/1368] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:33:30.465159 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-749130b1-303b-483b-ad1a-d15c728768b5 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1367 microversion: 2.1 time: 0.184177 Sep 06 16:33:30.466053 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 697/1369] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:30 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:31.489042 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-310a26f5-4c5c-464b-8276-277026154990 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:31.489759 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-310a26f5-4c5c-464b-8276-277026154990 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:31.498556 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-310a26f5-4c5c-464b-8276-277026154990 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:31.499429 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-310a26f5-4c5c-464b-8276-277026154990 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:31.500216 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-310a26f5-4c5c-464b-8276-277026154990 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:31.501277 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-310a26f5-4c5c-464b-8276-277026154990 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:31.501780 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-310a26f5-4c5c-464b-8276-277026154990 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:31.503163 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-310a26f5-4c5c-464b-8276-277026154990 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:31.645204 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-310a26f5-4c5c-464b-8276-277026154990 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:31.653017 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-310a26f5-4c5c-464b-8276-277026154990 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1367 microversion: 2.1 time: 0.168834 Sep 06 16:33:31.653590 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 673/1370] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:31 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:32.677908 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-6f096a78-d261-4241-8a1d-0c7719ab32ec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:32.678697 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-6f096a78-d261-4241-8a1d-0c7719ab32ec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:32.681033 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell0:SELECT=6 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:33:32.686620 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6f096a78-d261-4241-8a1d-0c7719ab32ec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:32.687100 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6f096a78-d261-4241-8a1d-0c7719ab32ec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:32.687528 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6f096a78-d261-4241-8a1d-0c7719ab32ec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:32.688218 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6f096a78-d261-4241-8a1d-0c7719ab32ec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:32.688664 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6f096a78-d261-4241-8a1d-0c7719ab32ec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:32.689134 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-6f096a78-d261-4241-8a1d-0c7719ab32ec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:32.824348 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-6f096a78-d261-4241-8a1d-0c7719ab32ec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:32.835919 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-6f096a78-d261-4241-8a1d-0c7719ab32ec tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1557 microversion: 2.1 time: 0.162148 Sep 06 16:33:32.836515 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 698/1371] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:32 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:32.859993 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cc0b7d4e-2eab-4b1c-9453-b7a79f38df28 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:32.861157 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cc0b7d4e-2eab-4b1c-9453-b7a79f38df28 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:32.862584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=2 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:33:32.863240 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell0:SELECT=6 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:33:32.869993 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cc0b7d4e-2eab-4b1c-9453-b7a79f38df28 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:32.870460 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cc0b7d4e-2eab-4b1c-9453-b7a79f38df28 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:32.870884 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cc0b7d4e-2eab-4b1c-9453-b7a79f38df28 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:32.871586 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cc0b7d4e-2eab-4b1c-9453-b7a79f38df28 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:32.872020 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cc0b7d4e-2eab-4b1c-9453-b7a79f38df28 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:32.872442 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cc0b7d4e-2eab-4b1c-9453-b7a79f38df28 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:32.971754 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cc0b7d4e-2eab-4b1c-9453-b7a79f38df28 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115841 Sep 06 16:33:32.972357 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 674/1372] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Sep 6 16:33:32 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:33:34.005327 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-364242cc-cefd-42de-96b3-4fae0137b3bd req-fc511d8e-8d8d-4d24-ac54-d31235325995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d22d29-352f-4e8f-8ef3-de43737e3ce8", "tag": "512c569c-063e-4ed3-b385-2a10ea7e3cd7"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:33:34.019255 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-364242cc-cefd-42de-96b3-4fae0137b3bd req-fc511d8e-8d8d-4d24-ac54-d31235325995 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:34.019730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-364242cc-cefd-42de-96b3-4fae0137b3bd req-fc511d8e-8d8d-4d24-ac54-d31235325995 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:34.020150 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-364242cc-cefd-42de-96b3-4fae0137b3bd req-fc511d8e-8d8d-4d24-ac54-d31235325995 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:34.032178 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-364242cc-cefd-42de-96b3-4fae0137b3bd req-fc511d8e-8d8d-4d24-ac54-d31235325995 service nova] Creating event network-changed:512c569c-063e-4ed3-b385-2a10ea7e3cd7 for instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 on hv-cinder-85221 Sep 06 16:33:34.045037 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-364242cc-cefd-42de-96b3-4fae0137b3bd req-fc511d8e-8d8d-4d24-ac54-d31235325995 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046366 Sep 06 16:33:34.045787 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 699/1373] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:34:38.701984 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:34:38.702827 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG dbcounter [-] [120669] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:34:38.707098 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4aefa173-e561-495c-85b8-36069c4b7f19 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:38.707568 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4aefa173-e561-495c-85b8-36069c4b7f19 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:38.715661 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4aefa173-e561-495c-85b8-36069c4b7f19 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:38.716132 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4aefa173-e561-495c-85b8-36069c4b7f19 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:38.716608 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4aefa173-e561-495c-85b8-36069c4b7f19 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:38.717317 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4aefa173-e561-495c-85b8-36069c4b7f19 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:38.717765 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4aefa173-e561-495c-85b8-36069c4b7f19 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:38.718182 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4aefa173-e561-495c-85b8-36069c4b7f19 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:38.746897 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4aefa173-e561-495c-85b8-36069c4b7f19 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/ips" status: 200 len: 149 microversion: 2.1 time: 0.046695 Sep 06 16:34:38.747486 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 675/1374] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Sep 6 16:34:38 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:34:40.110998 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:34:40.111730 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG dbcounter [-] [120668] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:34:40.116351 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fbf92e5b-a01d-4b7a-a29f-a91d4e85cc48 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "432f1a4b-953c-47e1-9639-cdf390a3cbb5"}} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:34:40.118932 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fbf92e5b-a01d-4b7a-a29f-a91d4e85cc48 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:40.126773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fbf92e5b-a01d-4b7a-a29f-a91d4e85cc48 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:40.127248 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fbf92e5b-a01d-4b7a-a29f-a91d4e85cc48 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:40.127671 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fbf92e5b-a01d-4b7a-a29f-a91d4e85cc48 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:40.128344 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fbf92e5b-a01d-4b7a-a29f-a91d4e85cc48 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:40.128793 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fbf92e5b-a01d-4b7a-a29f-a91d4e85cc48 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:40.129238 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fbf92e5b-a01d-4b7a-a29f-a91d4e85cc48 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:40.420909 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fbf92e5b-a01d-4b7a-a29f-a91d4e85cc48 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "POST /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311898 Sep 06 16:34:40.421561 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 700/1375] 10.222.0.43 () {60 vars in 1323 bytes} [Tue Sep 6 16:34:40 2022] POST /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:34:48.105239 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-78d550bc-03ea-4855-825e-b50cd63ff688 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:48.105878 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-78d550bc-03ea-4855-825e-b50cd63ff688 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:48.115524 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78d550bc-03ea-4855-825e-b50cd63ff688 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:48.115916 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78d550bc-03ea-4855-825e-b50cd63ff688 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:48.116349 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78d550bc-03ea-4855-825e-b50cd63ff688 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:48.117185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78d550bc-03ea-4855-825e-b50cd63ff688 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:48.117641 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78d550bc-03ea-4855-825e-b50cd63ff688 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:48.118061 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-78d550bc-03ea-4855-825e-b50cd63ff688 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:48.210215 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-78d550bc-03ea-4855-825e-b50cd63ff688 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lazy-loading 'services' on Instance uuid a2d22d29-352f-4e8f-8ef3-de43737e3ce8 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:34:48.297310 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-78d550bc-03ea-4855-825e-b50cd63ff688 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/os-volume_attachments/432f1a4b-953c-47e1-9639-cdf390a3cbb5" status: 202 len: 0 microversion: 2.1 time: 0.195935 Sep 06 16:34:48.298513 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 676/1376] 10.222.0.43 () {58 vars in 1416 bytes} [Tue Sep 6 16:34:48 2022] DELETE /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/os-volume_attachments/432f1a4b-953c-47e1-9639-cdf390a3cbb5 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:34:48.309182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-fe95a72a-5c2b-44cb-bc6d-a6ed4fe739a8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:48.311620 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-fe95a72a-5c2b-44cb-bc6d-a6ed4fe739a8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:48.314879 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:34:48.315754 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Tue Sep 6 16:34:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/os-volume_attachments (ip 10.222.0.43) !!! Sep 06 16:34:48.322436 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fe95a72a-5c2b-44cb-bc6d-a6ed4fe739a8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:48.323087 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fe95a72a-5c2b-44cb-bc6d-a6ed4fe739a8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:48.323509 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fe95a72a-5c2b-44cb-bc6d-a6ed4fe739a8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:48.324499 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fe95a72a-5c2b-44cb-bc6d-a6ed4fe739a8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:48.325095 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fe95a72a-5c2b-44cb-bc6d-a6ed4fe739a8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:48.325631 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-fe95a72a-5c2b-44cb-bc6d-a6ed4fe739a8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:48.363095 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-fe95a72a-5c2b-44cb-bc6d-a6ed4fe739a8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058502 Sep 06 16:34:48.363663 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 701/1377] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:34:48 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:34:49.377614 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-4f595703-291c-4bf5-8035-e8959e3a3c84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:49.379934 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-4f595703-291c-4bf5-8035-e8959e3a3c84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:49.386817 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f595703-291c-4bf5-8035-e8959e3a3c84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:49.387295 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f595703-291c-4bf5-8035-e8959e3a3c84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:49.387736 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f595703-291c-4bf5-8035-e8959e3a3c84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:49.388450 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f595703-291c-4bf5-8035-e8959e3a3c84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:49.388941 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f595703-291c-4bf5-8035-e8959e3a3c84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:49.389333 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-4f595703-291c-4bf5-8035-e8959e3a3c84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:49.427573 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-4f595703-291c-4bf5-8035-e8959e3a3c84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055003 Sep 06 16:34:49.428151 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 677/1378] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Sep 6 16:34:49 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:34:49.500796 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c2c02631-6d1f-4cb6-80ad-6a6d8c413a84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:49.501419 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c2c02631-6d1f-4cb6-80ad-6a6d8c413a84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:49.509610 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c2c02631-6d1f-4cb6-80ad-6a6d8c413a84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:49.510079 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c2c02631-6d1f-4cb6-80ad-6a6d8c413a84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:49.510504 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c2c02631-6d1f-4cb6-80ad-6a6d8c413a84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:49.511185 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c2c02631-6d1f-4cb6-80ad-6a6d8c413a84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:49.511626 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c2c02631-6d1f-4cb6-80ad-6a6d8c413a84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:49.512035 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c2c02631-6d1f-4cb6-80ad-6a6d8c413a84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:49.538159 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c2c02631-6d1f-4cb6-80ad-6a6d8c413a84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Going to try to terminate instance {{(pid=120668) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:34:49.620127 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c2c02631-6d1f-4cb6-80ad-6a6d8c413a84 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 204 len: 0 microversion: 2.1 time: 0.125042 Sep 06 16:34:49.621085 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 702/1379] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:34:49 2022] DELETE /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:34:49.629642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-9a8529be-8ffe-47c9-ad21-ae282572df06 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:49.630268 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-9a8529be-8ffe-47c9-ad21-ae282572df06 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:49.636315 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a8529be-8ffe-47c9-ad21-ae282572df06 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:49.636826 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a8529be-8ffe-47c9-ad21-ae282572df06 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:49.637273 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a8529be-8ffe-47c9-ad21-ae282572df06 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:49.637956 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a8529be-8ffe-47c9-ad21-ae282572df06 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:49.638400 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a8529be-8ffe-47c9-ad21-ae282572df06 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:49.638816 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-9a8529be-8ffe-47c9-ad21-ae282572df06 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:49.775804 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-9a8529be-8ffe-47c9-ad21-ae282572df06 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:34:49.788734 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-9a8529be-8ffe-47c9-ad21-ae282572df06 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1681 microversion: 2.1 time: 0.162997 Sep 06 16:34:49.789633 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 678/1380] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:34:49 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:34:50.815341 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-eff6adda-9ba4-410a-ba7c-4363863fe35d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:50.816006 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-eff6adda-9ba4-410a-ba7c-4363863fe35d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:50.823373 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eff6adda-9ba4-410a-ba7c-4363863fe35d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:50.823870 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eff6adda-9ba4-410a-ba7c-4363863fe35d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:50.824297 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eff6adda-9ba4-410a-ba7c-4363863fe35d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:50.825039 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eff6adda-9ba4-410a-ba7c-4363863fe35d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:50.825483 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eff6adda-9ba4-410a-ba7c-4363863fe35d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:50.825934 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-eff6adda-9ba4-410a-ba7c-4363863fe35d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:50.964222 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.policy [None req-eff6adda-9ba4-410a-ba7c-4363863fe35d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120668) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:34:50.972452 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-eff6adda-9ba4-410a-ba7c-4363863fe35d tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1681 microversion: 2.1 time: 0.161625 Sep 06 16:34:50.973081 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 703/1381] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:34:50 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:34:51.995902 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-5c2efb10-0a91-4ed2-85c3-23a9c2db0aa1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:51.996629 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-5c2efb10-0a91-4ed2-85c3-23a9c2db0aa1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:52.003382 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c2efb10-0a91-4ed2-85c3-23a9c2db0aa1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:52.003869 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c2efb10-0a91-4ed2-85c3-23a9c2db0aa1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:52.004312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c2efb10-0a91-4ed2-85c3-23a9c2db0aa1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:52.005062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c2efb10-0a91-4ed2-85c3-23a9c2db0aa1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:52.005517 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c2efb10-0a91-4ed2-85c3-23a9c2db0aa1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:52.005953 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-5c2efb10-0a91-4ed2-85c3-23a9c2db0aa1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:52.089449 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-5c2efb10-0a91-4ed2-85c3-23a9c2db0aa1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:34:52.097474 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-5c2efb10-0a91-4ed2-85c3-23a9c2db0aa1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1614 microversion: 2.1 time: 0.105503 Sep 06 16:34:52.108975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 679/1382] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:34:51 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1614 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:34:52.636271 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [req-f2e526a1-2f80-4c29-9a4b-b1230fe9583a req-882aa6da-307f-4306-b65a-50f4aae29e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d22d29-352f-4e8f-8ef3-de43737e3ce8", "name": "network-vif-deleted", "tag": "512c569c-063e-4ed3-b385-2a10ea7e3cd7"}]} {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:34:52.647863 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-f2e526a1-2f80-4c29-9a4b-b1230fe9583a req-882aa6da-307f-4306-b65a-50f4aae29e69 service nova] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:52.648804 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-f2e526a1-2f80-4c29-9a4b-b1230fe9583a req-882aa6da-307f-4306-b65a-50f4aae29e69 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:52.649258 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [req-f2e526a1-2f80-4c29-9a4b-b1230fe9583a req-882aa6da-307f-4306-b65a-50f4aae29e69 service nova] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:52.662723 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.compute.server_external_events [req-f2e526a1-2f80-4c29-9a4b-b1230fe9583a req-882aa6da-307f-4306-b65a-50f4aae29e69 service nova] Creating event network-vif-deleted:512c569c-063e-4ed3-b385-2a10ea7e3cd7 for instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 on hv-cinder-85221 Sep 06 16:34:52.670048 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [req-f2e526a1-2f80-4c29-9a4b-b1230fe9583a req-882aa6da-307f-4306-b65a-50f4aae29e69 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037311 Sep 06 16:34:52.670988 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 704/1383] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Sep 6 16:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:34:53.119975 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:53.120645 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:53.128425 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:53.129084 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:53.129681 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:53.130523 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:53.131090 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:53.131577 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:53.169020 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:53.169580 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:53.170087 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:53.170570 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.objects.instance [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lazy-loading 'fault' on Instance uuid a2d22d29-352f-4e8f-8ef3-de43737e3ce8 {{(pid=120669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:34:53.220141 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.policy [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523faa1ac64e4044b9fb651ec28249d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c722f58536f492aa4eb96085452def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120669) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:34:53.229088 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-cda513d8-1524-4723-ba51-63778adcce63 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 200 len: 1332 microversion: 2.1 time: 0.113205 Sep 06 16:34:53.229575 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 680/1384] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:34:53 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:34:54.253008 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b0e90ed8-45ae-4b40-8ba3-dce5d6590fb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:54.253735 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-b0e90ed8-45ae-4b40-8ba3-dce5d6590fb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:54.260719 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b0e90ed8-45ae-4b40-8ba3-dce5d6590fb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:54.261250 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b0e90ed8-45ae-4b40-8ba3-dce5d6590fb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:54.261680 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b0e90ed8-45ae-4b40-8ba3-dce5d6590fb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:54.262371 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b0e90ed8-45ae-4b40-8ba3-dce5d6590fb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:54.262821 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b0e90ed8-45ae-4b40-8ba3-dce5d6590fb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:54.263262 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-b0e90ed8-45ae-4b40-8ba3-dce5d6590fb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:54.277656 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-b0e90ed8-45ae-4b40-8ba3-dce5d6590fb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b0e90ed8-45ae-4b40-8ba3-dce5d6590fb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 HTTP/1.1 Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:34:54.279299 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:34:54.281376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:34:54.281376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:54.281376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:54.281376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:54.281376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:54.281376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:34:54.281376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:34:54.281376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:34:54.281376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:54.281376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:34:54.281376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:54.281376 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'a2d22d29-352f-4e8f-8ef3-de43737e3ce8'} Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:34:54.282393 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:54.284163 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:54.285799 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-b0e90ed8-45ae-4b40-8ba3-dce5d6590fb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 404 to user: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:34:54.285799 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-b0e90ed8-45ae-4b40-8ba3-dce5d6590fb3 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 404 len: 111 microversion: 2.1 time: 0.032585 Sep 06 16:34:54.285799 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 705/1385] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:34:54 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:34:54.290146 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-85cf1673-1187-4470-b58b-d3a591e63990 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '.version_select at 0x7f83e943b310>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:54.311062 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-85cf1673-1187-4470-b58b-d3a591e63990 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061128481" status: 202 len: 0 microversion: 2.1 time: 0.024939 Sep 06 16:34:54.311629 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 681/1386] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Sep 6 16:34:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061128481 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:34:56.081175 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-76588fb9-b8ee-4d15-912b-9f588c99dfb6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:56.081713 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-76588fb9-b8ee-4d15-912b-9f588c99dfb6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:56.088459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76588fb9-b8ee-4d15-912b-9f588c99dfb6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:56.088966 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76588fb9-b8ee-4d15-912b-9f588c99dfb6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:56.089394 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76588fb9-b8ee-4d15-912b-9f588c99dfb6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:56.090078 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76588fb9-b8ee-4d15-912b-9f588c99dfb6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:56.090522 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76588fb9-b8ee-4d15-912b-9f588c99dfb6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:56.090937 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-76588fb9-b8ee-4d15-912b-9f588c99dfb6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:56.105513 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-76588fb9-b8ee-4d15-912b-9f588c99dfb6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-76588fb9-b8ee-4d15-912b-9f588c99dfb6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: DELETE /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 HTTP/1.1 Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:34:56.107054 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:34:56.108816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:34:56.108816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:56.108816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:56.108816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:56.108816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:56.108816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:34:56.108816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:34:56.108816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:34:56.108816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:56.108816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:34:56.108816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:56.108816 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'a2d22d29-352f-4e8f-8ef3-de43737e3ce8'} Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:34:56.110678 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:56.112397 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:56.114081 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-76588fb9-b8ee-4d15-912b-9f588c99dfb6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 404 to user: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:34:56.114081 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-76588fb9-b8ee-4d15-912b-9f588c99dfb6 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 404 len: 111 microversion: 2.1 time: 0.031089 Sep 06 16:34:56.114081 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 706/1387] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:34:56 2022] DELETE /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:34:56.117170 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-08a006f7-f918-4eb4-9054-eac67f2b05c1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:56.117779 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-08a006f7-f918-4eb4-9054-eac67f2b05c1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2d22d29-352f-4e8f-8ef3-de43737e3ce8] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:56.125420 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-08a006f7-f918-4eb4-9054-eac67f2b05c1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:56.125898 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-08a006f7-f918-4eb4-9054-eac67f2b05c1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:56.126327 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-08a006f7-f918-4eb4-9054-eac67f2b05c1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:56.127010 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-08a006f7-f918-4eb4-9054-eac67f2b05c1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:56.127458 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-08a006f7-f918-4eb4-9054-eac67f2b05c1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:56.127873 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-08a006f7-f918-4eb4-9054-eac67f2b05c1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:56.141786 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-08a006f7-f918-4eb4-9054-eac67f2b05c1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-08a006f7-f918-4eb4-9054-eac67f2b05c1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 HTTP/1.1 Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:34:56.143436 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:34:56.149334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:34:56.149334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:56.149334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:56.149334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:56.149334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:56.149334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:34:56.149334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:34:56.149334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:34:56.149334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:56.149334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:34:56.149334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:56.149334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'a2d22d29-352f-4e8f-8ef3-de43737e3ce8'} Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:34:56.150334 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. Sep 06 16:34:56.151978 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:56.153920 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-08a006f7-f918-4eb4-9054-eac67f2b05c1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 404 to user: Instance a2d22d29-352f-4e8f-8ef3-de43737e3ce8 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:34:56.153920 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-08a006f7-f918-4eb4-9054-eac67f2b05c1 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8" status: 404 len: 111 microversion: 2.1 time: 0.031571 Sep 06 16:34:56.153920 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 682/1388] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:34:56 2022] GET /compute/v2.1/servers/a2d22d29-352f-4e8f-8ef3-de43737e3ce8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:34:57.290805 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a3e86424-6c7f-4142-b80d-1a36fd458c98 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:57.291404 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-a3e86424-6c7f-4142-b80d-1a36fd458c98 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:57.299444 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a3e86424-6c7f-4142-b80d-1a36fd458c98 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:57.299942 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a3e86424-6c7f-4142-b80d-1a36fd458c98 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:57.300530 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a3e86424-6c7f-4142-b80d-1a36fd458c98 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:57.301308 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a3e86424-6c7f-4142-b80d-1a36fd458c98 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:57.302469 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a3e86424-6c7f-4142-b80d-1a36fd458c98 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:57.302936 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-a3e86424-6c7f-4142-b80d-1a36fd458c98 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:57.320056 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-a3e86424-6c7f-4142-b80d-1a36fd458c98 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a3e86424-6c7f-4142-b80d-1a36fd458c98 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: DELETE /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 HTTP/1.1 Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:34:57.321692 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:34:57.323446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:34:57.323446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:57.323446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:57.323446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:57.323446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:57.323446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:34:57.323446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:34:57.323446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:34:57.323446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:57.323446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:34:57.323446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:34:57.323446 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': '64057754-3a69-4878-bec9-f7b1d6eeee24'} Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:34:57.324381 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:34:57.326103 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.328169 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-a3e86424-6c7f-4142-b80d-1a36fd458c98 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 404 to user: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:34:57.328169 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-a3e86424-6c7f-4142-b80d-1a36fd458c98 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 404 len: 111 microversion: 2.1 time: 0.036426 Sep 06 16:34:57.328169 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 707/1389] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:34:57 2022] DELETE /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:34:57.332048 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1312fd9e-b04b-4059-8bef-db29bc4e21d4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:57.332657 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-1312fd9e-b04b-4059-8bef-db29bc4e21d4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: 64057754-3a69-4878-bec9-f7b1d6eeee24] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:57.339693 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1312fd9e-b04b-4059-8bef-db29bc4e21d4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:57.340172 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1312fd9e-b04b-4059-8bef-db29bc4e21d4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:57.340607 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1312fd9e-b04b-4059-8bef-db29bc4e21d4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:57.341343 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1312fd9e-b04b-4059-8bef-db29bc4e21d4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:57.341790 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1312fd9e-b04b-4059-8bef-db29bc4e21d4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:57.342214 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-1312fd9e-b04b-4059-8bef-db29bc4e21d4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:57.357781 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-1312fd9e-b04b-4059-8bef-db29bc4e21d4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1312fd9e-b04b-4059-8bef-db29bc4e21d4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 HTTP/1.1 Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:34:57.359312 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:34:57.361188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:34:57.361188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:57.361188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:57.361188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:57.361188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:57.361188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:34:57.361188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:34:57.361188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:34:57.361188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:57.361188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:34:57.361188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:34:57.361188 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': '64057754-3a69-4878-bec9-f7b1d6eeee24'} Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:34:57.362180 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. Sep 06 16:34:57.364185 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.365806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-1312fd9e-b04b-4059-8bef-db29bc4e21d4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 404 to user: Instance 64057754-3a69-4878-bec9-f7b1d6eeee24 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:34:57.365806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-1312fd9e-b04b-4059-8bef-db29bc4e21d4 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24" status: 404 len: 111 microversion: 2.1 time: 0.033463 Sep 06 16:34:57.365806 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 683/1390] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:34:57 2022] GET /compute/v2.1/servers/64057754-3a69-4878-bec9-f7b1d6eeee24 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:34:57.371401 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-787d819f-37f1-4d12-a1c4-61df230ce2e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:57.371898 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-787d819f-37f1-4d12-a1c4-61df230ce2e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:57.378769 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-787d819f-37f1-4d12-a1c4-61df230ce2e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:57.379306 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-787d819f-37f1-4d12-a1c4-61df230ce2e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:57.379785 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-787d819f-37f1-4d12-a1c4-61df230ce2e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:57.380583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-787d819f-37f1-4d12-a1c4-61df230ce2e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:57.381108 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-787d819f-37f1-4d12-a1c4-61df230ce2e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:57.381583 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-787d819f-37f1-4d12-a1c4-61df230ce2e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:57.396619 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-787d819f-37f1-4d12-a1c4-61df230ce2e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-787d819f-37f1-4d12-a1c4-61df230ce2e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: DELETE /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 HTTP/1.1 Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:34:57.398281 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:34:57.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:34:57.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:57.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:57.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:57.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:57.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:34:57.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:34:57.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:34:57.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:57.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:34:57.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:34:57.400092 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'a2a83e1d-7bb7-4e42-8a31-530ded48a350'} Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:34:57.401143 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:34:57.402926 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.404607 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-787d819f-37f1-4d12-a1c4-61df230ce2e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 404 to user: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:34:57.404607 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-787d819f-37f1-4d12-a1c4-61df230ce2e8 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 404 len: 111 microversion: 2.1 time: 0.032573 Sep 06 16:34:57.404607 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 708/1391] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:34:57 2022] DELETE /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:34:57.408990 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-da70a627-9422-410d-b28f-952ce4abda2b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:57.409609 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-da70a627-9422-410d-b28f-952ce4abda2b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: a2a83e1d-7bb7-4e42-8a31-530ded48a350] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:57.415959 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da70a627-9422-410d-b28f-952ce4abda2b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:57.416453 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da70a627-9422-410d-b28f-952ce4abda2b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:57.417190 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da70a627-9422-410d-b28f-952ce4abda2b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:57.417878 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da70a627-9422-410d-b28f-952ce4abda2b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:57.418351 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da70a627-9422-410d-b28f-952ce4abda2b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:57.418766 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-da70a627-9422-410d-b28f-952ce4abda2b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:57.432794 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-da70a627-9422-410d-b28f-952ce4abda2b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-da70a627-9422-410d-b28f-952ce4abda2b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 HTTP/1.1 Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:34:57.434316 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:34:57.436074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:34:57.436074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:57.436074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:57.436074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:57.436074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:57.436074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:34:57.436074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:34:57.436074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:34:57.436074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:57.436074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:34:57.436074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:34:57.436074 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'a2a83e1d-7bb7-4e42-8a31-530ded48a350'} Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:34:57.437127 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. Sep 06 16:34:57.438795 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:57.440222 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-da70a627-9422-410d-b28f-952ce4abda2b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 404 to user: Instance a2a83e1d-7bb7-4e42-8a31-530ded48a350 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:34:57.440222 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-da70a627-9422-410d-b28f-952ce4abda2b tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350" status: 404 len: 111 microversion: 2.1 time: 0.030887 Sep 06 16:34:57.440222 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 684/1392] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:34:57 2022] GET /compute/v2.1/servers/a2a83e1d-7bb7-4e42-8a31-530ded48a350 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:34:58.578172 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c4c67bc2-9403-44f2-a062-1d7c061f98b2 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:58.578924 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.compute.api [None req-c4c67bc2-9403-44f2-a062-1d7c061f98b2 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120668) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:58.585856 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c4c67bc2-9403-44f2-a062-1d7c061f98b2 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:58.586339 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c4c67bc2-9403-44f2-a062-1d7c061f98b2 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:58.586773 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c4c67bc2-9403-44f2-a062-1d7c061f98b2 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:58.587462 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c4c67bc2-9403-44f2-a062-1d7c061f98b2 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:58.587914 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c4c67bc2-9403-44f2-a062-1d7c061f98b2 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:58.588337 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG oslo_concurrency.lockutils [None req-c4c67bc2-9403-44f2-a062-1d7c061f98b2 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:58.602303 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.wsgi [None req-c4c67bc2-9403-44f2-a062-1d7c061f98b2 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c4c67bc2-9403-44f2-a062-1d7c061f98b2 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: request: DELETE /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 HTTP/1.1 Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept: application/json Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Accept-Encoding: identity Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Connection: close Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Length: 0 Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Content-Type: application/json Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Host: 10.222.0.43 Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: Openstack-System-Scope: None Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: User-Agent: python-urllib3/1.26.12 Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Id: None Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Domain-Name: None Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Identity-Status: Confirmed Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Is-Admin-Project: True Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Id: default Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Domain-Name: Default Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Role: reader,member Sep 06 16:34:58.603865 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Roles: reader,member Sep 06 16:34:58.605828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:34:58.605828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:58.605828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:58.605828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:58.605828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:58.605828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Id: default Sep 06 16:34:58.605828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Domain-Name: Default Sep 06 16:34:58.605828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:34:58.605828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:58.605828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: method: > Sep 06 16:34:58.605828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: exception: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:34:58.605828 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: action_args: {'id': 'e7d7393f-d0b9-480d-bfe7-36439a86c064'} Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: {{(pid=120668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:34:58.607182 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:34:58.609495 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: ERROR nova.api.openstack.wsgi Sep 06 16:34:58.611459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: DEBUG nova.api.openstack.wsgi [None req-c4c67bc2-9403-44f2-a062-1d7c061f98b2 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 404 to user: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. {{(pid=120668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:34:58.611459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: INFO nova.api.openstack.requestlog [None req-c4c67bc2-9403-44f2-a062-1d7c061f98b2 tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 404 len: 111 microversion: 2.1 time: 0.031084 Sep 06 16:34:58.611459 dv-cinder-852210-10-iscsi devstack@n-api.service[120668]: [pid: 120668|app: 0|req: 709/1393] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Sep 6 16:34:58 2022] DELETE /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:34:58.614034 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6e4fee4e-c5bd-4b40-a365-9cdc33f8821a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Calling method '>' {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:34:58.614642 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.compute.api [None req-6e4fee4e-c5bd-4b40-a365-9cdc33f8821a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] [instance: e7d7393f-d0b9-480d-bfe7-36439a86c064] Fetching instance by UUID {{(pid=120669) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:34:58.621534 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6e4fee4e-c5bd-4b40-a365-9cdc33f8821a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:58.622011 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6e4fee4e-c5bd-4b40-a365-9cdc33f8821a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:58.622438 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6e4fee4e-c5bd-4b40-a365-9cdc33f8821a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:58.623114 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6e4fee4e-c5bd-4b40-a365-9cdc33f8821a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Acquiring lock "862cff72-aa43-46ea-ad81-5a77b03254c2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:34:58.623555 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6e4fee4e-c5bd-4b40-a365-9cdc33f8821a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:34:58.623967 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG oslo_concurrency.lockutils [None req-6e4fee4e-c5bd-4b40-a365-9cdc33f8821a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Lock "862cff72-aa43-46ea-ad81-5a77b03254c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:34:58.637877 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.wsgi [None req-6e4fee4e-c5bd-4b40-a365-9cdc33f8821a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] HTTP exception thrown: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6e4fee4e-c5bd-4b40-a365-9cdc33f8821a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Request method failure captured: Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: request: GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 HTTP/1.1 Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept: application/json Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Accept-Encoding: identity Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Connection: close Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Length: 0 Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Content-Type: application/json Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Host: 10.222.0.43 Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: Openstack-System-Scope: None Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: User-Agent: python-urllib3/1.26.12 Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Auth-Token: gAAAAABjF3T6s7ncuipJEBOvy0zCXGannbbwISSKAItI_rl97BEzwqY_r36X9zf-5nRWc6EeSgVgR3iTXtBLeO9DivTL1CwcssgupgdZnh-0h66Ai1a_CVfAQTrmX2uJQJhjgVzGsxf3IFZjNEo01IGP_t1yTaKGRNvvBn210zvV3FR7uGb2uRM Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Id: None Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Domain-Name: None Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Identity-Status: Confirmed Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Is-Admin-Project: True Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Id: default Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Domain-Name: Default Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Project-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Role: reader,member Sep 06 16:34:58.639584 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Roles: reader,member Sep 06 16:34:58.642380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c722f58536f492aa4eb96085452def4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c722f58536f492aa4eb96085452def4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c722f58536f492aa4eb96085452def4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Sep 06 16:34:58.642380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:58.642380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Id: 5c722f58536f492aa4eb96085452def4 Sep 06 16:34:58.642380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1702505125 Sep 06 16:34:58.642380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:58.642380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Id: default Sep 06 16:34:58.642380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Domain-Name: Default Sep 06 16:34:58.642380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Id: 523faa1ac64e4044b9fb651ec28249d9 Sep 06 16:34:58.642380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: X-User-Name: tempest-AttachVolumeNegativeTest-1702505125-project Sep 06 16:34:58.642380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: method: > Sep 06 16:34:58.642380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: exception: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:34:58.642380 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: action_args: {'id': 'e7d7393f-d0b9-480d-bfe7-36439a86c064'} Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: {{(pid=120669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:34:58.643979 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. Sep 06 16:34:58.646810 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: ERROR nova.api.openstack.wsgi Sep 06 16:34:58.649863 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: DEBUG nova.api.openstack.wsgi [None req-6e4fee4e-c5bd-4b40-a365-9cdc33f8821a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] Returning 404 to user: Instance e7d7393f-d0b9-480d-bfe7-36439a86c064 could not be found. {{(pid=120669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:34:58.649863 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: INFO nova.api.openstack.requestlog [None req-6e4fee4e-c5bd-4b40-a365-9cdc33f8821a tempest-AttachVolumeNegativeTest-1702505125 tempest-AttachVolumeNegativeTest-1702505125-project] 10.222.0.43 "GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064" status: 404 len: 111 microversion: 2.1 time: 0.030925 Sep 06 16:34:58.649863 dv-cinder-852210-10-iscsi devstack@n-api.service[120669]: [pid: 120669|app: 0|req: 685/1394] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Sep 6 16:34:58 2022] GET /compute/v2.1/servers/e7d7393f-d0b9-480d-bfe7-36439a86c064 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)